00010000:00000001:1.0F:1787719734.808287:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719734.808314:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719734.808322:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719734.808324:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0F:1787719734.808585:0:247359:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719734.808594:0:247359:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719734.808597:0:247359:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719735.844591:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719735.844599:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719735.844606:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719735.844607:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0F:1787719735.844811:0:235674:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719735.844823:0:235674:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719735.844826:0:235674:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1787719736.344209:0:279660:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092bb30 (cpu 3) has reached its deadline 4307211483, at 4307211520 00000100:00000010:3.0:1787719736.344227:0:279660:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083f5b5e540. 00000100:00000040:2.0:1787719736.349509:0:282307:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092ba20 (cpu 2) has reached its deadline 4307211483, at 4307211525 00000100:00000010:2.0:1787719736.349531:0:282307:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083f5b5ef60. 00000800:00000200:3.0:1787719736.611983:0:2389:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083c394a9c0] -> 12345-192.168.204.55@tcp (6) 00000800:00000200:3.0:1787719736.611992:0:2389:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.55@tcp ip 192.168.204.55:988 00000800:00000200:3.0:1787719736.611998:0:2389:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083c96cae00 type 192, nob 24 niov 1 nkiov 0 00000800:00000200:2.0:1787719736.614628:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000001:2.0:1787719736.614654:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719736.614669:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1787719736.614675:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719736.614678:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:1.0:1787719736.856347:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719736.856355:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719736.856361:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719736.856363:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719736.856612:0:235673:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719736.856615:0:235673:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719736.856618:0:235673:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0F:1787719737.629617:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1787719737.629637:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1787719737.629644:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fa6e1880. 00000020:00000040:0.0:1787719737.629650:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083c501b000 refcount=4 obd=MGC192.168.204.155@tcp 00000100:00000001:0.0:1787719737.629654:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1787719737.629657:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1787719737.629672:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1787719737.629719:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa082d58ed800. 00000100:00000001:0.0:1787719737.629728:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629742:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1787719737.629753:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1787719737.629757:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629763:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a7396d11] to pc [ptlrpcd_00_01+1] req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.629789:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629792:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1787719737.629796:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1787719737.629799:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fa6e0700. 00000020:00000040:0.0:1787719737.629802:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083f3a62800 refcount=9 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000100:00000001:0.0:1787719737.629804:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1787719737.629806:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1787719737.629807:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1787719737.629810:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa082d58ed500. 00000100:00000001:0.0:1787719737.629814:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629818:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1787719737.629824:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1787719737.629826:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629829:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001822a65b] to pc [ptlrpcd_00_00+0] req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.629837:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629844:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1787719737.629847:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1787719737.629850:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fa6e1f80. 00000020:00000040:0.0:1787719737.629867:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083f3a67000 refcount=4 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000100:00000001:0.0:1787719737.629870:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1787719737.629871:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1787719737.629873:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1787719737.629878:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa082d58edc00. 00000100:00000001:0.0:1787719737.629881:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629886:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1787719737.629894:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1787719737.629896:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629901:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e922f534] to pc [ptlrpcd_00_01+1] req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.629909:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629911:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1787719737.629915:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1787719737.629917:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fa6e3100. 00000020:00000040:0.0:1787719737.629920:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083d05ac800 refcount=4 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000100:00000001:0.0:1787719737.629922:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1787719737.629923:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1787719737.629924:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1787719737.629928:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083e2369a00. 00000100:00000001:0.0:1787719737.629930:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629934:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1787719737.629942:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1787719737.629944:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629948:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b98b770e] to pc [ptlrpcd_00_00+0] req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.629967:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.629969:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1787719737.629973:0:232999:0:(pinger.c:247:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1787719737.629977:0:232999:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (12550) 00000100:00000001:0.0:1787719737.629989:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.629992:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719737.629995:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719737.630001:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630009:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719737.630012:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630016:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719737.630019:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719737.630022:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719737.630026:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fa6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075725184:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.630031:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719737.630036:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719737.630039:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630041:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719737.630045:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412aa00. 02000000:00000001:0.0:1787719737.630047:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719737.630055:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.630059:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a210. 00000400:00000010:0.0:1787719737.630066:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a3b8. 00000100:00000200:0.0:1787719737.630073:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725184, portal 25 00000100:00000001:0.0:1787719737.630075:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719737.630077:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087435520128 : -104986274031488 : ffffa083fa6e1880) 00000100:00000040:0.0:1787719737.630111:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630118:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719737.630127:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719737.630130:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5ae58. 00000100:00000200:0.0:1787719737.630134:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1874547075725184, offset 0 00000400:00000200:0.0:1787719737.630141:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630150:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630158:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719737.630164:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719737.630168:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719737.630173:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719737.630175:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630179:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540703:540703:256:4294967295] 192.168.204.155@tcp LPNI seq info [540638:540638:8:4294967295] 00000400:00000200:0.0:1787719737.630184:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630193:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719737.630199:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719737.630204:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e2369000. 00000800:00000200:0.0:1787719737.630211:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719737.630218:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719737.630222:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e2369000 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719737.630241:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719737.630246:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.630249:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 2 is 4307216588 00000100:00000010:0.0:1787719737.630254:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083d08ec420. 00000100:00000001:0.0:1787719737.630261:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1787719737.630266:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 3 is 4307216588 00000100:00000010:0.0:1787719737.630269:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083d08ecd80. 00000100:00000001:0.0:1787719737.630272:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1787719737.630275:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.630278:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630280:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719737.630285:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630301:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719737.630302:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630304:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719737.630306:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719737.630308:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719737.630311:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fa6e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725440:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.630313:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719737.630316:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719737.630317:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630319:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719737.630321:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412ae00. 02000000:00000001:0.0:1787719737.630323:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719737.630326:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.630329:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a840. 00000400:00000010:0.0:1787719737.630332:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5aaa0. 00000100:00000200:0.0:1787719737.630335:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725440, portal 10 00000100:00000001:0.0:1787719737.630337:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719737.630338:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087435521920 : -104986274029696 : ffffa083fa6e1f80) 00000100:00000040:0.0:1787719737.630344:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630351:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719737.630353:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719737.630356:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a088. 00000100:00000200:0.0:1787719737.630358:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075725440, offset 0 00000400:00000200:0.0:1787719737.630362:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630366:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630369:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719737.630372:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719737.630375:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719737.630378:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719737.630380:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630388:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540704:540704:255:4294967295] 192.168.204.155@tcp LPNI seq info [540639:540639:7:4294967295] 00000400:00000200:0.0:1787719737.630392:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630399:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719737.630403:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719737.630407:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e2369600. 00000800:00000200:0.0:1787719737.630410:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719737.630415:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719737.630417:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e2369600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719737.630420:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.630424:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: using a timeout of 24062 usecs (25 jiffies) 00000400:00000200:0.0:1787719737.630427:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.630429:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307212830 00000100:00000001:0.0:1787719737.630432:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630446:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307212830 00000100:00000001:0.0:1787719737.630448:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630451:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.630453:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630456:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630458:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.630465:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719737.630468:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1787719737.630470:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.630471:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719737.630473:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719737.630476:0:2399:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000001:0.0:1787719737.630477:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.630479:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719737.630480:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.630482:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.630483:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719737.630484:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719737.630488:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630501:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719737.630502:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630505:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719737.630507:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719737.630508:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719737.630512:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fa6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725312:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.630515:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719737.630517:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719737.630519:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630520:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719737.630523:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412be00. 02000000:00000001:0.0:1787719737.630524:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719737.630528:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.630530:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a688. 00000400:00000010:0.0:1787719737.630533:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a6e8. 00000100:00000200:0.0:1787719737.630536:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725312, portal 10 00000100:00000001:0.0:1787719737.630538:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719737.630539:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087435515648 : -104986274035968 : ffffa083fa6e0700) 00000100:00000040:0.0:1787719737.630544:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630551:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719737.630553:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719737.630555:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5aa18. 00000100:00000200:0.0:1787719737.630557:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075725312, offset 0 00000400:00000200:0.0:1787719737.630562:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630565:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630569:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719737.630571:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719737.630573:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719737.630575:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719737.630577:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630590:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540705:540705:254:4294967295] 192.168.204.155@tcp LPNI seq info [540640:540640:6:4294967295] 00000400:00000200:0.0:1787719737.630593:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630599:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719737.630602:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719737.630606:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e31ab600. 00000800:00000200:0.0:1787719737.630610:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719737.630614:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719737.630617:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e31ab600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719737.630619:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.630622:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: using a timeout of 27150 usecs (28 jiffies) 00000400:00000200:0.0:1787719737.630624:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.630626:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307212833 00000100:00000001:0.0:1787719737.630628:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630629:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307212833 00000100:00000001:0.0:1787719737.630631:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630633:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.630635:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630637:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719737.630640:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630647:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719737.630648:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630650:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719737.630651:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719737.630653:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719737.630656:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fa6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725568:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.630659:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719737.630661:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719737.630663:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.630669:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719737.630674:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412b200. 02000000:00000001:0.0:1787719737.630675:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719737.630679:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.630681:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9acb8. 00000400:00000010:0.0:1787719737.630685:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a5d8. 00000100:00000200:0.0:1787719737.630688:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725568, portal 4 00000100:00000001:0.0:1787719737.630691:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719737.630692:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087435526400 : -104986274025216 : ffffa083fa6e3100) 00000100:00000040:0.0:1787719737.630698:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.630704:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719737.630706:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719737.630708:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a440. 00000100:00000200:0.0:1787719737.630711:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1874547075725568, offset 0 00000400:00000200:0.0:1787719737.630715:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630718:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630721:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719737.630724:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719737.630726:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719737.630728:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719737.630730:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719737.630733:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540706:540706:253:4294967295] 192.168.204.155@tcp LPNI seq info [540641:540641:5:4294967295] 00000400:00000200:0.0:1787719737.630736:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719737.630742:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719737.630746:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719737.630750:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e31ab500. 00000800:00000200:0.0:1787719737.630754:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719737.630758:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719737.630761:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e31ab500 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719737.630763:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.630773:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: using a timeout of 167336 usecs (168 jiffies) 00000400:00000200:0.0:1787719737.630778:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.630781:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307212973 00000100:00000001:0.0:1787719737.630783:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630785:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307212973 00000100:00000001:0.0:1787719737.630787:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307216588 00000100:00000001:0.0:1787719737.630789:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.630791:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630793:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630796:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.630808:0:2398:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.630810:0:2398:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1787719737.631448:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719737.631454:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e2369000. 00000400:00000200:2.0:1787719737.631462:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719737.631467:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719737.631473:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5ae58 00000400:00000010:2.0:1787719737.631476:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5ae58. 00000100:00000001:2.0:1787719737.631480:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719737.631497:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631508:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719737.631511:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631518:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719737.631520:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719737.631535:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719737.631538:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e2369600. 00000400:00000200:2.0:1787719737.631541:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719737.631544:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719737.631547:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a088 00000400:00000010:2.0:1787719737.631549:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a088. 00000100:00000001:2.0:1787719737.631551:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719737.631555:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631561:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719737.631572:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631578:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719737.631580:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719737.631591:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719737.631593:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e31ab600. 00000400:00000200:2.0:1787719737.631596:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719737.631599:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719737.631602:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5aa18 00000400:00000010:2.0:1787719737.631603:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5aa18. 00000100:00000001:2.0:1787719737.631605:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719737.631608:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631616:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719737.631619:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631625:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719737.631626:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719737.631702:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719737.631705:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e31ab500. 00000400:00000200:2.0:1787719737.631708:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719737.631711:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719737.631713:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a440 00000400:00000010:2.0:1787719737.631715:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a440. 00000100:00000001:2.0:1787719737.631717:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719737.631720:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631727:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719737.631730:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719737.631735:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719737.631737:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1787719737.637632:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637652:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719737.637657:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637659:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637670:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637679:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719737.637689:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637694:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637700:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637716:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 25 MB=0x6a8e400903780 00000400:00000200:3.0:1787719737.637722:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637728:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.155@tcp of length 224/224 into md 0x510405 [1] + 224 00000800:00000001:3.0:1787719737.637737:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637742:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637746:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719737.637751:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719737.637759:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719737.637769:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719737.637798:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719737.637818:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719737.637841:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637845:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719737.637847:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637849:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637852:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637856:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719737.637860:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637862:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637866:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637869:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 4 MB=0x6a8e400903900 00000400:00000200:3.0:1787719737.637873:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637877:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.155@tcp of length 224/224 into md 0x51041d [1] + 224 00000800:00000001:3.0:1787719737.637881:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637884:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637886:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:0.0:1787719737.637888:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:3.0:1787719737.637890:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719737.637895:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:0.0:1787719737.637895:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000200:3.0:1787719737.637902:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000001:0.0:1787719737.637904:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719737.637908:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719737.637913:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a210. 00000100:00000040:3.0:1787719737.637916:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1787719737.637919:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a3b8 00000400:00000010:0.0:1787719737.637924:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a3b8. 00000100:00000001:3.0:1787719737.637930:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719737.637932:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000800:00000001:3.0:1787719737.637935:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637940:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1787719737.637941:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000001:3.0:1787719737.637943:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.637946:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637953:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000200:0.0:1787719737.637962:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1787719737.637963:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719737.637972:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719737.637978:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.637981:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000400:00000200:3.0:1787719737.637984:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.637985:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.637990:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903880 00000100:00000001:0.0:1787719737.637992:0:2399:0:(client.c:1593:after_reply()) Process entered 00000400:00000200:3.0:1787719737.637997:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 02000000:00000001:0.0:1787719737.637997:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719737.638000:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719737.638004:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.638009:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719737.638010:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x51040d [1] + 224 00000100:00001000:0.0:1787719737.638016:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083c501b460 time=130 v=5 (5 5 5 5) 00000800:00000001:3.0:1787719737.638017:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.638023:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00001000:0.0:1787719737.638023:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083c501b418 time=147 v=5 (1 1 1 1) 00000400:00000200:3.0:1787719737.638027:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:0.0:1787719737.638029:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000400:00000200:3.0:1787719737.638033:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719737.638036:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:0.0:1787719737.638039:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1787719737.638043:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1787719737.638044:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719737.638048:0:2399:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638053:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719737.638060:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787719737.638063:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638109:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1787719737.638111:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719737.638115:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000800:00000001:3.0:1787719737.638118:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000100:00000001:0.0:1787719737.638118:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719737.638124:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000001:3.0:1787719737.638125:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719737.638129:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719737.638133:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.638141:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00100000:0.0:1787719737.638141:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fa6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075725184:192.168.204.155@tcp:400:kworker.0 00000400:00000200:3.0:1787719737.638149:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000001:0.0:1787719737.638152:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719737.638155:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000200:3.0:1787719737.638158:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.638158:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a840. 00000400:00000200:0.0:1787719737.638163:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5aaa0 00000400:00000200:3.0:1787719737.638164:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719737.638167:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5aaa0. 00000400:00000200:3.0:1787719737.638172:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.638174:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000400:00000200:3.0:1787719737.638178:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903800 00000100:00000200:0.0:1787719737.638180:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719737.638189:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1787719737.638198:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719737.638202:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719737.638205:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719737.638209:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x510415 [1] + 224 00000100:00000001:0.0:1787719737.638209:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719737.638212:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719737.638214:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000800:00000001:3.0:1787719737.638217:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000100:00000001:0.0:1787719737.638217:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.638221:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:3.0:1787719737.638227:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00001000:0.0:1787719737.638229:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a67460 time=129 v=5 (60 60 60 60) 00000400:00000200:3.0:1787719737.638231:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00001000:0.0:1787719737.638234:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a67418 time=116 v=5 (1 1 1 1) 00000400:00000200:3.0:1787719737.638237:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719737.638240:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719737.638245:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638251:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000040:3.0:1787719737.638258:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638259:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719737.638262:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1787719737.638269:0:2399:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719737.638287:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00010000:00000001:0.0:1787719737.638288:0:2399:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638293:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000800:00000001:3.0:1787719737.638295:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000100:00000040:0.0:1787719737.638295:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffffa083fa1ea800: skip recheck: last_committed 21474836545 00000100:00000001:0.0:1787719737.638300:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000800:00000001:3.0:1787719737.638302:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638302:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.638309:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638315:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.638317:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719737.638318:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719737.638322:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719737.638328:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fa6e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725440:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.638333:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638336:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719737.638339:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fa6e1880 x1874547075725184/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638345:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719737.638348:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719737.638352:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412aa00. 02000000:00000001:0.0:1787719737.638355:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719737.638357:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719737.638359:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083c501b000 refcount=3 obd=MGC192.168.204.155@tcp 00000020:00000001:0.0:1787719737.638361:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719737.638363:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa082d58ed800. 02000000:00000001:0.0:1787719737.638368:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719737.638369:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719737.638376:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fa6e1880. 00000100:00000001:0.0:1787719737.638380:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719737.638381:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638383:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719737.638386:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fa6e1f80 x1874547075725440/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638391:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719737.638392:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719737.638394:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412ae00. 02000000:00000001:0.0:1787719737.638395:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719737.638397:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719737.638398:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a67000 refcount=3 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719737.638400:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719737.638401:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa082d58edc00. 02000000:00000001:0.0:1787719737.638403:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719737.638404:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719737.638405:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fa6e1f80. 00000100:00000001:0.0:1787719737.638407:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719737.638408:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638412:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638413:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.638415:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1787719737.638418:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719737.638419:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719737.638420:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a688. 00000400:00000200:0.0:1787719737.638423:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a6e8 00000400:00000010:0.0:1787719737.638424:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a6e8. 00000100:00000001:0.0:1787719737.638426:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719737.638430:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719737.638438:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638445:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719737.638446:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638448:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719737.638456:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719737.638457:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719737.638459:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.638461:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719737.638466:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a62c60 time=129 v=5 (60 60 60 60) 00000100:00001000:0.0:1787719737.638469:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a62c18 time=145 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719737.638471:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719737.638472:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719737.638474:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719737.638476:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638479:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719737.638480:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffffa083fa1ea800: skip recheck: last_committed 30064771624 00000100:00000001:0.0:1787719737.638481:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719737.638483:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.638496:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638502:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.638504:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719737.638505:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719737.638508:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719737.638515:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fa6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725312:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719737.638520:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719737.638521:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719737.638523:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9acb8. 00000400:00000200:0.0:1787719737.638525:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a5d8 00000400:00000010:0.0:1787719737.638527:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a5d8. 00000100:00000001:0.0:1787719737.638529:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719737.638532:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719737.638538:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638553:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719737.638555:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638556:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719737.638558:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719737.638559:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719737.638560:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719737.638561:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719737.638566:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083d05acc60 time=129 v=5 (5 5 5 5) 00000100:00001000:0.0:1787719737.638569:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083d05acc18 time=136 v=5 (1 1 0 0) 00000100:00000001:0.0:1787719737.638571:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719737.638572:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719737.638573:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719737.638575:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638577:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719737.638578:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-ffffa083fa1ea800: skip recheck: last_committed 42949695836 00000100:00000001:0.0:1787719737.638580:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719737.638581:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719737.638585:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638590:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719737.638591:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719737.638593:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719737.638596:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719737.638603:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fa6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075725568:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719737.638606:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638608:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719737.638610:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fa6e0700 x1874547075725312/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638616:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719737.638617:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719737.638624:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412be00. 02000000:00000001:0.0:1787719737.638626:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719737.638627:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719737.638629:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a62800 refcount=8 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719737.638631:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719737.638642:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa082d58ed500. 02000000:00000001:0.0:1787719737.638645:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719737.638646:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719737.638648:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fa6e0700. 00000100:00000001:0.0:1787719737.638650:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719737.638651:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638653:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719737.638657:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fa6e3100 x1874547075725568/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719753 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719737.638663:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719737.638664:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719737.638665:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412b200. 02000000:00000001:0.0:1787719737.638667:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719737.638669:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719737.638670:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083d05ac800 refcount=3 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000020:00000001:0.0:1787719737.638671:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719737.638673:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083e2369a00. 02000000:00000001:0.0:1787719737.638675:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719737.638676:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719737.638677:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fa6e3100. 00000100:00000001:0.0:1787719737.638679:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719737.638680:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638682:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719737.638689:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719737.638691:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719737.638693:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719737.638694:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719737.880757:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719737.880764:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719737.880770:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719737.880772:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719737.885714:0:251484:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719737.885721:0:251484:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719737.885726:0:251484:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719738.909462:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719738.909469:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719738.909476:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719738.909477:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719738.911025:0:241647:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719738.911032:0:241647:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719738.911037:0:241647:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719739.929325:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719739.929334:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719739.929342:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719739.929343:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719739.930465:0:247359:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719739.930471:0:247359:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719739.930475:0:247359:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719740.953935:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719740.953942:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719740.953948:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719740.953949:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719740.955271:0:235674:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719740.955275:0:235674:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719740.955279:0:235674:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1787719741.466120:0:279660:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092bb30 (cpu 3) has reached its deadline 4307216588, at 4307216642 00000100:00000010:3.0:1787719741.466139:0:279660:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083d08ecd80. 00000100:00000040:2.0:1787719741.466198:0:282307:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092ba20 (cpu 2) has reached its deadline 4307216588, at 4307216642 00000100:00000010:2.0:1787719741.466205:0:282307:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083d08ec420. 00010000:00000001:1.0:1787719741.977924:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719741.977931:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719741.977939:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719741.977940:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719741.978080:0:235673:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719741.978083:0:235673:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719741.978086:0:235673:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1787719742.745578:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1787719742.745588:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1787719742.745600:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083d099bb80. 00000020:00000040:3.0:1787719742.745607:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083c501b000 refcount=4 obd=MGC192.168.204.155@tcp 00000100:00000001:3.0:1787719742.745612:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1787719742.745615:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1787719742.745619:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1787719742.745627:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083d5575900. 00000100:00000001:3.0:1787719742.745634:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745645:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1787719742.745657:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1787719742.745661:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745668:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd185b17] to pc [ptlrpcd_01_00+0] req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.745707:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745710:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1787719742.745713:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1787719742.745716:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083d0999c00. 00000020:00000040:3.0:1787719742.745732:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083f3a62800 refcount=9 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000100:00000001:3.0:1787719742.745735:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1787719742.745736:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1787719742.745738:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1787719742.745742:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083d5575d00. 00000100:00000001:3.0:1787719742.745745:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745750:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1787719742.745758:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1787719742.745760:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745764:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000094dcd25] to pc [ptlrpcd_01_01+1] req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.745773:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745775:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1787719742.745778:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1787719742.745780:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083d0999180. 00000020:00000040:3.0:1787719742.745782:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083f3a67000 refcount=4 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000100:00000001:3.0:1787719742.745784:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1787719742.745785:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1787719742.745786:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1787719742.745789:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083d5575600. 00000100:00000001:3.0:1787719742.745792:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745796:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1787719742.745802:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1787719742.745804:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745808:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a4864f5] to pc [ptlrpcd_01_00+0] req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.745816:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745818:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1787719742.745826:0:232999:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1787719742.745829:0:232999:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083d099b100. 00000020:00000040:3.0:1787719742.745832:0:232999:0:(genops.c:1210:class_import_get()) import ffffa083d05ac800 refcount=4 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000100:00000001:3.0:1787719742.745833:0:232999:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1787719742.745835:0:232999:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1787719742.745837:0:232999:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1787719742.745840:0:232999:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083d5575400. 00000100:00000001:3.0:1787719742.745843:0:232999:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745847:0:232999:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1787719742.745854:0:232999:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1787719742.745856:0:232999:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745859:0:232999:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a9b1ec88] to pc [ptlrpcd_01_01+1] req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.745865:0:232999:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.745867:0:232999:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1787719742.745871:0:232999:0:(pinger.c:247:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1787719742.745875:0:232999:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (12555) 00000100:00000001:3.0:1787719742.745890:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1787719742.745893:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1787719742.745895:0:2401:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1787719742.745900:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.745907:0:2401:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1787719742.745909:0:2401:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.745912:0:2401:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1787719742.745914:0:2401:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1787719742.745917:0:2401:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1787719742.745920:0:2401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083d0999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075725824:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719742.745925:0:2401:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1787719742.745937:0:2401:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1787719742.745939:0:2401:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.745942:0:2401:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1787719742.745946:0:2401:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083e05a8800. 02000000:00000001:3.0:1787719742.745948:0:2401:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719742.745956:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:3.0:1787719742.745960:0:2401:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083c9996f20. 00000400:00000010:3.0:1787719742.745967:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569f68. 00000100:00000200:3.0:1787719742.745974:0:2401:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725824, portal 10 00000100:00000001:3.0:1787719742.745976:0:2401:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1787719742.745978:0:2401:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639086733728768 : -104986975822848 : ffffa083d0999c00) 00000100:00000040:3.0:1787719742.745997:0:2401:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746005:0:2401:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1787719742.746008:0:2401:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:3.0:1787719742.746011:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569ee0. 00000100:00000200:3.0:1787719742.746014:0:2401:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075725824, offset 0 00000400:00000200:3.0:1787719742.746021:0:2401:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746029:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746036:0:2401:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:3.0:1787719742.746041:0:2401:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1787719742.746045:0:2401:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:3.0:1787719742.746049:0:2401:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1787719742.746052:0:2401:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746056:0:2401:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540707:540707:256:4294967295] 192.168.204.155@tcp LPNI seq info [540642:540642:8:4294967295] 00000400:00000200:3.0:1787719742.746060:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746069:0:2401:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:3.0:1787719742.746075:0:2401:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:3.0:1787719742.746080:0:2401:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083d5575100. 00000800:00000200:3.0:1787719742.746087:0:2401:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:3.0:1787719742.746121:0:2401:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:3.0:1787719742.746125:0:2401:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083d5575100 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1787719742.746141:0:2401:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.746145:0:2401:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: using a timeout of 27145 usecs (28 jiffies) 00000400:00000200:3.0:1787719742.746149:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:3.0:1787719742.746152:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307217950 00000100:00000010:3.0:1787719742.746156:0:2401:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083fa3b7d80. 00000100:00000001:3.0:1787719742.746163:0:2401:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request now active for cpu 2 00000100:00000001:3.0:1787719742.746172:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307217950 00000100:00000010:3.0:1787719742.746176:0:2401:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083fa3b7e40. 00000100:00000001:3.0:1787719742.746179:0:2401:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request now active for cpu 3 00000100:00000001:3.0:1787719742.746182:0:2401:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1787719742.746184:0:2401:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746187:0:2401:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1787719742.746191:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746198:0:2401:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1787719742.746199:0:2401:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.746201:0:2401:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1787719742.746203:0:2401:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1787719742.746205:0:2401:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1787719742.746208:0:2401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083d099b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075726080:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719742.746211:0:2401:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1787719742.746214:0:2401:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1787719742.746215:0:2401:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.746217:0:2401:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1787719742.746219:0:2401:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083e05a8a00. 02000000:00000001:3.0:1787719742.746221:0:2401:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719742.746225:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:3.0:1787719742.746228:0:2401:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083c99963c8. 00000400:00000010:3.0:1787719742.746231:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569e58. 00000100:00000200:3.0:1787719742.746234:0:2401:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726080, portal 4 00000100:00000001:3.0:1787719742.746236:0:2401:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1787719742.746242:0:2401:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639086733734144 : -104986975817472 : ffffa083d099b100) 00000100:00000040:3.0:1787719742.746248:0:2401:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746255:0:2401:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1787719742.746257:0:2401:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:3.0:1787719742.746260:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569088. 00000100:00000200:3.0:1787719742.746262:0:2401:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1874547075726080, offset 0 00000400:00000200:3.0:1787719742.746267:0:2401:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746271:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746274:0:2401:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:3.0:1787719742.746276:0:2401:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1787719742.746278:0:2401:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:3.0:1787719742.746280:0:2401:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1787719742.746282:0:2401:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746285:0:2401:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540708:540708:255:4294967295] 192.168.204.155@tcp LPNI seq info [540643:540643:7:4294967295] 00000400:00000200:3.0:1787719742.746289:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746295:0:2401:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:3.0:1787719742.746299:0:2401:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:3.0:1787719742.746303:0:2401:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083d5575e00. 00000800:00000200:3.0:1787719742.746307:0:2401:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:3.0:1787719742.746311:0:2401:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:3.0:1787719742.746314:0:2401:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083d5575e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1787719742.746317:0:2401:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.746320:0:2401:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: using a timeout of 167223 usecs (168 jiffies) 00000400:00000200:3.0:1787719742.746322:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:3.0:1787719742.746324:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307218090 00000100:00000001:3.0:1787719742.746329:0:2401:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 2, simply extend its deadline from 4307217950 00000100:00000001:3.0:1787719742.746332:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307218090 00000100:00000001:3.0:1787719742.746334:0:2401:0:(niobuf.c:685:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 3, simply extend its deadline from 4307217950 00000100:00000001:3.0:1787719742.746342:0:2401:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1787719742.746343:0:2401:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746346:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746348:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.746355:0:2401:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1787719742.746357:0:2401:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1787719742.746359:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1787719742.746361:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1787719742.746362:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1787719742.746364:0:2401:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000001:3.0:1787719742.746366:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.746368:0:2401:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1787719742.746370:0:2401:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.746371:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1787719742.746372:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1787719742.746374:0:2401:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1787719742.746379:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746386:0:2401:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1787719742.746388:0:2401:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.746390:0:2401:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1787719742.746392:0:2401:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1787719742.746392:0:2400:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:3.0:1787719742.746397:0:2401:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.746397:0:2400:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1787719742.746403:0:2401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083d099bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2401:1874547075725696:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719742.746406:0:2401:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1787719742.746409:0:2401:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1787719742.746411:0:2401:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.746413:0:2401:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1787719742.746415:0:2401:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083e05a9200. 02000000:00000001:3.0:1787719742.746417:0:2401:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719742.746420:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:3.0:1787719742.746423:0:2401:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083c9996268. 00000400:00000010:3.0:1787719742.746427:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f55695d8. 00000100:00000200:3.0:1787719742.746430:0:2401:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725696, portal 25 00000100:00000001:3.0:1787719742.746432:0:2401:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1787719742.746438:0:2401:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639086733736832 : -104986975814784 : ffffa083d099bb80) 00000100:00000040:3.0:1787719742.746445:0:2401:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:2.0:1787719742.746451:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000100:00000001:3.0:1787719742.746454:0:2401:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000800:00000010:2.0:1787719742.746457:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083d5575100. 00000100:00000040:3.0:1787719742.746459:0:2401:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:3.0:1787719742.746463:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f55692a8. 00000400:00000200:2.0:1787719742.746466:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:3.0:1787719742.746467:0:2401:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1874547075725696, offset 0 00000400:00000200:3.0:1787719742.746476:0:2401:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:2.0:1787719742.746477:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:3.0:1787719742.746483:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746487:0:2401:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:3.0:1787719742.746490:0:2401:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1787719742.746492:0:2401:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:3.0:1787719742.746495:0:2401:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1787719742.746497:0:2401:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746500:0:2401:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540709:540709:254:4294967295] 192.168.204.155@tcp LPNI seq info [540644:540644:6:4294967295] 00000400:00000200:3.0:1787719742.746504:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746510:0:2401:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:3.0:1787719742.746514:0:2401:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000400:00000200:2.0:1787719742.746516:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569ee0 00000800:00000010:3.0:1787719742.746519:0:2401:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083d5575a00. 00000400:00000010:2.0:1787719742.746521:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569ee0. 00000800:00000200:3.0:1787719742.746526:0:2401:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000100:00000001:2.0:1787719742.746528:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000800:00000200:3.0:1787719742.746534:0:2401:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000100:00000200:2.0:1787719742.746536:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:3.0:1787719742.746538:0:2401:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083d5575a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1787719742.746545:0:2401:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719742.746552:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:2.0:1787719742.746553:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000001:3.0:1787719742.746555:0:2401:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 2 is 4307221705 00000100:00000040:2.0:1787719742.746560:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746561:0:2401:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4307218090 00000100:00000001:3.0:1787719742.746567:0:2401:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 3 is 4307221705 00000100:00000001:3.0:1787719742.746572:0:2401:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4307218090 00000100:00000001:2.0:1787719742.746574:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746578:0:2401:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1787719742.746578:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1787719742.746582:0:2401:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746591:0:2401:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000800:00000200:2.0:1787719742.746591:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719742.746595:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083d5575e00. 00000400:00000200:2.0:1787719742.746599:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000040:3.0:1787719742.746600:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1787719742.746605:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719742.746610:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569088 00000400:00000010:2.0:1787719742.746613:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569088. 00000100:00000001:3.0:1787719742.746616:0:2401:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1787719742.746617:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000001:3.0:1787719742.746619:0:2401:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.746621:0:2401:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1787719742.746623:0:2401:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1787719742.746626:0:2401:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1787719742.746631:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787719742.746632:0:2401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083d0999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075725952:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719742.746640:0:2401:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1787719742.746644:0:2401:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1787719742.746647:0:2401:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.746647:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 02000000:00000001:3.0:1787719742.746651:0:2401:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000040:2.0:1787719742.746654:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000010:3.0:1787719742.746657:0:2401:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083e05a9a00. 02000000:00000001:3.0:1787719742.746662:0:2401:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.746668:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719742.746671:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:2.0:1787719742.746672:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000400:00000010:3.0:1787719742.746677:0:2401:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083c9996e70. 00000400:00000010:3.0:1787719742.746683:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569d48. 00000100:00000200:3.0:1787719742.746686:0:2401:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075725952, portal 10 00000100:00000001:3.0:1787719742.746687:0:2401:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1787719742.746688:0:2401:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639086733726080 : -104986975825536 : ffffa083d0999180) 00000100:00000040:3.0:1787719742.746695:0:2401:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746702:0:2401:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1787719742.746704:0:2401:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:3.0:1787719742.746707:0:2401:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f5569b28. 00000100:00000200:3.0:1787719742.746710:0:2401:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075725952, offset 0 00000400:00000200:3.0:1787719742.746714:0:2401:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:3.0:1787719742.746718:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746721:0:2401:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:3.0:1787719742.746724:0:2401:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1787719742.746727:0:2401:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:3.0:1787719742.746730:0:2401:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1787719742.746736:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1787719742.746740:0:2401:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000800:00000010:2.0:1787719742.746741:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083d5575a00. 00000400:00000200:2.0:1787719742.746745:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719742.746746:0:2401:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540710:540710:255:4294967295] 192.168.204.155@tcp LPNI seq info [540645:540645:7:4294967295] 00000400:00000200:2.0:1787719742.746753:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:3.0:1787719742.746756:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.746763:0:2401:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:3.0:1787719742.746768:0:2401:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000400:00000200:2.0:1787719742.746768:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f55692a8 00000400:00000010:2.0:1787719742.746772:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f55692a8. 00000800:00000010:3.0:1787719742.746774:0:2401:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083d5575700. 00000100:00000001:2.0:1787719742.746777:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000800:00000200:3.0:1787719742.746781:0:2401:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000100:00000200:2.0:1787719742.746783:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:3.0:1787719742.746792:0:2401:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000100:00000001:2.0:1787719742.746797:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000800:00000200:3.0:1787719742.746798:0:2401:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083d5575700 type 1, nob 320 niov 1 nkiov 1 00000100:00000040:2.0:1787719742.746803:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.746804:0:2401:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.746810:0:2401:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: using a timeout of 24061 usecs (25 jiffies) 00000400:00000200:3.0:1787719742.746817:0:2401:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:2.0:1787719742.746817:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.746822:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1787719742.746823:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307217947 00000100:00000001:3.0:1787719742.746827:0:2401:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307221705 00000100:00000001:3.0:1787719742.746830:0:2401:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307217947 00000100:00000001:3.0:1787719742.746833:0:2401:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307221705 00000100:00000001:3.0:1787719742.746835:0:2401:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000800:00000200:2.0:1787719742.746835:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719742.746839:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083d5575700. 00000100:00000001:3.0:1787719742.746840:0:2401:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1787719742.746845:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:3.0:1787719742.746846:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.746851:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1787719742.746852:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719742.746858:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569b28 00000400:00000010:2.0:1787719742.746860:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569b28. 00000100:00000001:2.0:1787719742.746863:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719742.746866:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.746874:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719742.746877:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.746889:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.746891:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1787719742.754970:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.754997:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719742.755001:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755005:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719742.755015:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755023:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719742.755032:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755048:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755052:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755056:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 25 MB=0x6a8e400903980 00000400:00000200:3.0:1787719742.755075:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755082:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.155@tcp of length 224/224 into md 0x510445 [1] + 224 00000800:00000001:3.0:1787719742.755121:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755126:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719742.755140:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719742.755146:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719742.755153:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719742.755162:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719742.755174:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.755200:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719742.755208:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755212:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719742.755214:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755216:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719742.755219:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755222:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719742.755227:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755229:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755232:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755235:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903a80 00000400:00000200:3.0:1787719742.755239:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719742.755243:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x510455 [1] + 224 00000800:00000001:3.0:1787719742.755247:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755252:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719742.755254:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719742.755257:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719742.755260:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719742.755264:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719742.755284:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.755291:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719742.755296:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719742.755299:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1787719742.755492:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1787719742.755497:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1787719742.755503:0:2401:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1787719742.755505:0:2401:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1787719742.755509:0:2401:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083c9996268. 00000400:00000200:2.0:1787719742.755514:0:2401:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f55695d8 00000400:00000010:2.0:1787719742.755516:0:2401:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f55695d8. 00000100:00000001:2.0:1787719742.755519:0:2401:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719742.755523:0:2401:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1787719742.755532:0:2401:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755539:0:2401:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1787719742.755540:0:2401:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1787719742.755543:0:2401:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1787719742.755546:0:2401:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1787719742.755549:0:2401:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1787719742.755551:0:2401:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1787719742.755554:0:2401:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1787719742.755561:0:2401:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083c501b460 time=135 v=5 (5 5 5 5) 00000100:00001000:2.0:1787719742.755566:0:2401:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083c501b418 time=152 v=5 (1 1 1 1) 00000100:00000001:2.0:1787719742.755568:0:2401:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1787719742.755569:0:2401:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1787719742.755572:0:2401:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1787719742.755574:0:2401:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.755577:0:2401:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1787719742.755581:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755588:0:2401:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1787719742.755591:0:2401:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1787719742.755593:0:2401:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1787719742.755604:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787719742.755613:0:2401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083d099bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2401:1874547075725696:192.168.204.155@tcp:400:kworker.0 00000400:00000001:2.0:1787719742.755620:0:2401:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1787719742.755621:0:2401:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1787719742.755623:0:2401:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083c9996e70. 00000400:00000200:2.0:1787719742.755626:0:2401:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569d48 00000400:00000010:2.0:1787719742.755627:0:2401:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569d48. 00000100:00000001:2.0:1787719742.755630:0:2401:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719742.755633:0:2401:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1787719742.755642:0:2401:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755648:0:2401:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1787719742.755649:0:2401:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1787719742.755651:0:2401:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1787719742.755652:0:2401:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1787719742.755653:0:2401:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1787719742.755655:0:2401:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1787719742.755656:0:2401:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1787719742.755662:0:2401:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a67460 time=134 v=5 (60 60 60 60) 00000100:00001000:2.0:1787719742.755665:0:2401:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a67418 time=121 v=5 (1 1 1 1) 00000100:00000001:2.0:1787719742.755667:0:2401:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1787719742.755668:0:2401:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1787719742.755670:0:2401:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1787719742.755674:0:2401:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1787719742.755692:0:2401:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.755696:0:2401:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1787719742.755698:0:2401:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffffa083fa1ea800: skip recheck: last_committed 21474836545 00000100:00000001:2.0:1787719742.755700:0:2401:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1787719742.755706:0:2401:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1787719742.755711:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755717:0:2401:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1787719742.755719:0:2401:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1787719742.755720:0:2401:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1787719742.755723:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787719742.755730:0:2401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083d0999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075725952:192.168.204.155@tcp:400:kworker.0 00000100:00000001:2.0:1787719742.755735:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.755738:0:2401:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719742.755741:0:2401:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083d099bb80 x1874547075725696/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755748:0:2401:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1787719742.755750:0:2401:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1787719742.755754:0:2401:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083e05a9200. 02000000:00000001:2.0:1787719742.755758:0:2401:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1787719742.755761:0:2401:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1787719742.755763:0:2401:0:(genops.c:1223:class_import_put()) import ffffa083c501b000 refcount=3 obd=MGC192.168.204.155@tcp 00000020:00000001:2.0:1787719742.755765:0:2401:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1787719742.755768:0:2401:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083d5575900. 02000000:00000001:2.0:1787719742.755771:0:2401:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1787719742.755773:0:2401:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1787719742.755774:0:2401:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083d099bb80. 00000100:00000001:2.0:1787719742.755778:0:2401:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1787719742.755779:0:2401:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1787719742.755781:0:2401:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719742.755784:0:2401:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083d0999180 x1874547075725952/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.755791:0:2401:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1787719742.755792:0:2401:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1787719742.755793:0:2401:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083e05a9a00. 02000000:00000001:2.0:1787719742.755800:0:2401:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1787719742.755802:0:2401:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1787719742.755803:0:2401:0:(genops.c:1223:class_import_put()) import ffffa083f3a67000 refcount=3 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000020:00000001:2.0:1787719742.755805:0:2401:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1787719742.755807:0:2401:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083d5575600. 02000000:00000001:2.0:1787719742.755809:0:2401:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1787719742.755809:0:2401:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1787719742.755811:0:2401:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083d0999180. 00000100:00000001:2.0:1787719742.755814:0:2401:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1787719742.755815:0:2401:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1787719742.755818:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.755820:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1787719742.755822:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1787719742.755823:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719742.755825:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:2.0:1787719742.774582:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774603:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1787719742.774607:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774610:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719742.774619:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774627:0:2393:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:2.0:1787719742.774638:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774643:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774648:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774652:0:2393:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903a00 00000400:00000200:2.0:1787719742.774656:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774663:0:2393:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x510425 [1] + 224 00000800:00000001:2.0:1787719742.774671:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774676:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719742.774691:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719742.774696:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:2.0:1787719742.774703:0:2393:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719742.774714:0:2393:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787719742.774725:0:2393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.774767:0:2393:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1787719742.774778:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774782:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1787719742.774784:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774786:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719742.774789:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774793:0:2393:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:2.0:1787719742.774797:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774800:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774803:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774806:0:2393:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 4 MB=0x6a8e400903b00 00000400:00000200:2.0:1787719742.774809:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719742.774813:0:2393:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.155@tcp of length 224/224 into md 0x510435 [1] + 224 00000800:00000001:2.0:1787719742.774817:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774826:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719742.774828:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719742.774831:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:2.0:1787719742.774834:0:2393:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719742.774839:0:2393:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787719742.774848:0:2393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719742.774855:0:2393:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1787719742.774859:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719742.774861:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775059:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1787719742.775064:0:2401:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1787719742.775071:0:2401:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1787719742.775073:0:2401:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1787719742.775077:0:2401:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083c9996f20. 00000400:00000200:3.0:1787719742.775081:0:2401:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569f68 00000400:00000010:3.0:1787719742.775084:0:2401:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569f68. 00000100:00000001:3.0:1787719742.775087:0:2401:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719742.775120:0:2401:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1787719742.775136:0:2401:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775143:0:2401:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1787719742.775145:0:2401:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775147:0:2401:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1787719742.775150:0:2401:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1787719742.775153:0:2401:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1787719742.775155:0:2401:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.775159:0:2401:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1787719742.775169:0:2401:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a62c60 time=134 v=5 (60 60 60 60) 00000100:00001000:3.0:1787719742.775173:0:2401:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a62c18 time=150 v=5 (1 1 1 1) 00000100:00000001:3.0:1787719742.775176:0:2401:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1787719742.775178:0:2401:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1787719742.775180:0:2401:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1787719742.775183:0:2401:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.775187:0:2401:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1787719742.775189:0:2401:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffffa083fa1ea800: skip recheck: last_committed 30064771624 00000100:00000001:3.0:1787719742.775191:0:2401:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1787719742.775200:0:2401:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.775206:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775214:0:2401:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1787719742.775217:0:2401:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1787719742.775219:0:2401:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1787719742.775223:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787719742.775231:0:2401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083d0999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075725824:192.168.204.155@tcp:400:kworker.0 00000400:00000001:3.0:1787719742.775238:0:2401:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1787719742.775239:0:2401:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1787719742.775241:0:2401:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083c99963c8. 00000400:00000200:3.0:1787719742.775244:0:2401:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f5569e58 00000400:00000010:3.0:1787719742.775245:0:2401:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f5569e58. 00000100:00000001:3.0:1787719742.775248:0:2401:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719742.775251:0:2401:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1787719742.775257:0:2401:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775264:0:2401:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1787719742.775265:0:2401:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775267:0:2401:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1787719742.775268:0:2401:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1787719742.775270:0:2401:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1787719742.775271:0:2401:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1787719742.775273:0:2401:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1787719742.775278:0:2401:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083d05acc60 time=134 v=5 (5 5 5 5) 00000100:00001000:3.0:1787719742.775280:0:2401:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083d05acc18 time=141 v=5 (1 1 0 0) 00000100:00000001:3.0:1787719742.775283:0:2401:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1787719742.775284:0:2401:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1787719742.775286:0:2401:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1787719742.775288:0:2401:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.775297:0:2401:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1787719742.775298:0:2401:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-ffffa083fa1ea800: skip recheck: last_committed 42949695836 00000100:00000001:3.0:1787719742.775300:0:2401:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1787719742.775302:0:2401:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1787719742.775306:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775329:0:2401:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1787719742.775331:0:2401:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1787719742.775332:0:2401:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1787719742.775335:0:2401:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787719742.775343:0:2401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083d099b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2401:1874547075726080:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719742.775347:0:2401:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775350:0:2401:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1787719742.775353:0:2401:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083d0999c00 x1874547075725824/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775360:0:2401:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1787719742.775363:0:2401:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1787719742.775366:0:2401:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083e05a8800. 02000000:00000001:3.0:1787719742.775371:0:2401:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1787719742.775374:0:2401:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1787719742.775375:0:2401:0:(genops.c:1223:class_import_put()) import ffffa083f3a62800 refcount=8 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000020:00000001:3.0:1787719742.775377:0:2401:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1787719742.775379:0:2401:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083d5575d00. 02000000:00000001:3.0:1787719742.775382:0:2401:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1787719742.775383:0:2401:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1787719742.775385:0:2401:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083d0999c00. 00000100:00000001:3.0:1787719742.775388:0:2401:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1787719742.775390:0:2401:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775391:0:2401:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1787719742.775394:0:2401:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083d099b100 x1874547075726080/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719758 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719742.775408:0:2401:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1787719742.775410:0:2401:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1787719742.775411:0:2401:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083e05a8a00. 02000000:00000001:3.0:1787719742.775413:0:2401:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1787719742.775414:0:2401:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1787719742.775415:0:2401:0:(genops.c:1223:class_import_put()) import ffffa083d05ac800 refcount=3 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000020:00000001:3.0:1787719742.775417:0:2401:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1787719742.775419:0:2401:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083d5575400. 02000000:00000001:3.0:1787719742.775420:0:2401:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1787719742.775421:0:2401:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1787719742.775423:0:2401:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083d099b100. 00000100:00000001:3.0:1787719742.775425:0:2401:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1787719742.775426:0:2401:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775428:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719742.775436:0:2401:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1787719742.775438:0:2401:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1787719742.775440:0:2401:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1787719742.775442:0:2401:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719743.000934:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719743.000940:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719743.000946:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719743.000947:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719743.001048:0:251484:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719743.001051:0:251484:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719743.001054:0:251484:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719744.027882:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719744.027891:0:262853:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:1.0:1787719744.027893:0:262853:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:1.0:1787719744.027913:0:262853:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027919:0:262853:0:(ldlm_lockd.c:2378:ldlm_bl_to_thread()) Process entered 00010000:00000001:1.0:1787719744.027921:0:262853:0:(ldlm_lockd.c:2381:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027923:0:262853:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027926:0:262853:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027931:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719744.027932:0:262853:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:1.0:1787719744.027933:0:262853:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:1.0:1787719744.027938:0:262853:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1787719744.027940:0:262853:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1787719744.027942:0:262853:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027943:0:262853:0:(ldlm_lockd.c:2378:ldlm_bl_to_thread()) Process entered 00010000:00000001:1.0:1787719744.027944:0:262853:0:(ldlm_lockd.c:2381:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027946:0:262853:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719744.027948:0:262853:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719744.031078:0:241647:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719744.031086:0:241647:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719744.031152:0:241647:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719745.048513:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719745.048519:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719745.048524:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719745.048525:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719745.048619:0:247359:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719745.048623:0:247359:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719745.048626:0:247359:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719746.072461:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719746.072467:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719746.072474:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719746.072475:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719746.072796:0:235674:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719746.072803:0:235674:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719746.072808:0:235674:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1787719746.584257:0:279660:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092bb30 (cpu 3) has reached its deadline 4307221705, at 4307221760 00000100:00000010:3.0:1787719746.584290:0:279660:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083fa3b7e40. 00000100:00000040:2.0:1787719746.584370:0:282307:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092ba20 (cpu 2) has reached its deadline 4307221705, at 4307221760 00000100:00000010:2.0:1787719746.584475:0:282307:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083fa3b7d80. 00010000:00000001:1.0:1787719747.110455:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719747.110466:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719747.110474:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719747.110476:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1787719747.113597:0:235673:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1787719747.113608:0:235673:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1787719747.113614:0:235673:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1787719747.877899:0:250911:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719747.877910:0:250911:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719747.877920:0:250911:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadee680. 00000020:00000040:1.0:1787719747.877928:0:250911:0:(genops.c:1210:class_import_get()) import ffffa083c501b000 refcount=4 obd=MGC192.168.204.155@tcp 00000100:00000001:1.0:1787719747.877932:0:250911:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719747.877934:0:250911:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719747.877940:0:250911:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719747.877948:0:250911:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083d804f600. 00000100:00000001:1.0:1787719747.877954:0:250911:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.877967:0:250911:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719747.877994:0:250911:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719747.877998:0:250911:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878004:0:250911:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002b42eded] to pc [ptlrpcd_00_01+1] req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719747.878027:0:250911:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878030:0:250911:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719747.878032:0:250911:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719747.878035:0:250911:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadec700. 00000020:00000040:1.0:1787719747.878038:0:250911:0:(genops.c:1210:class_import_get()) import ffffa083f3a62800 refcount=9 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000100:00000001:1.0:1787719747.878040:0:250911:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719747.878041:0:250911:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719747.878043:0:250911:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719747.878048:0:250911:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083c3219700. 00000100:00000001:1.0:1787719747.878051:0:250911:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878055:0:250911:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719747.878062:0:250911:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719747.878064:0:250911:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878067:0:250911:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006625611d] to pc [ptlrpcd_00_00+0] req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719747.878074:0:250911:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878076:0:250911:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719747.878078:0:250911:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719747.878081:0:250911:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadec000. 00000020:00000040:1.0:1787719747.878083:0:250911:0:(genops.c:1210:class_import_get()) import ffffa083f3a67000 refcount=4 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000100:00000001:1.0:1787719747.878085:0:250911:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719747.878086:0:250911:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719747.878087:0:250911:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719747.878181:0:250911:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083c5aef500. 00000100:00000001:1.0:1787719747.878189:0:250911:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878194:0:250911:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719747.878201:0:250911:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719747.878203:0:250911:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878207:0:250911:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004c0c8350] to pc [ptlrpcd_00_01+1] req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719747.878213:0:250911:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878215:0:250911:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719747.878219:0:250911:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719747.878222:0:250911:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadece00. 00000020:00000040:1.0:1787719747.878224:0:250911:0:(genops.c:1210:class_import_get()) import ffffa083d05ac800 refcount=4 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000100:00000001:1.0:1787719747.878226:0:250911:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719747.878227:0:250911:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719747.878229:0:250911:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719747.878232:0:250911:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083c5aef200. 00000100:00000001:1.0:1787719747.878235:0:250911:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878239:0:250911:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719747.878245:0:250911:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719747.878247:0:250911:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878250:0:250911:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000020986d49] to pc [ptlrpcd_00_00+0] req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719747.878257:0:250911:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719747.878259:0:250911:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1787719747.878263:0:250911:0:(pinger.c:247:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1787719747.878268:0:250911:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (12560) 00000100:00000001:0.0:1787719747.880264:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719747.880274:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719747.880284:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719747.880296:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880309:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719747.880312:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.880316:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719747.880319:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719747.880323:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719747.880327:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075726208:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719747.880332:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719747.880339:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719747.880343:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.880345:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719747.880351:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412a800. 02000000:00000001:0.0:1787719747.880353:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719747.880361:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719747.880366:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9acb8. 00000400:00000010:0.0:1787719747.880373:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a5d8. 00000100:00000200:0.0:1787719747.880380:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726208, portal 25 00000100:00000001:0.0:1787719747.880383:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719747.880385:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442912896 : -104986266638720 : ffffa083fadee680) 00000100:00000040:0.0:1787719747.880392:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880401:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719747.880404:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719747.880408:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a6e8. 00000100:00000200:0.0:1787719747.880411:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1874547075726208, offset 0 00000400:00000200:0.0:1787719747.880418:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719747.880427:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.880435:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719747.880440:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719747.880445:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719747.880449:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719747.880457:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719747.880462:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540711:540711:256:4294967295] 192.168.204.155@tcp LPNI seq info [540646:540646:8:4294967295] 00000400:00000200:0.0:1787719747.880467:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.880479:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719747.880486:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719747.880491:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa082d58ed500. 00000800:00000200:0.0:1787719747.880497:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719747.880507:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719747.880512:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa082d58ed500 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719747.880533:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719747.880538:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719747.880540:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 2 is 4307226839 00000100:00000010:0.0:1787719747.880545:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083d08ecb40. 00000100:00000001:0.0:1787719747.880551:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1787719747.880557:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 3 is 4307226839 00000100:00000010:0.0:1787719747.880560:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083d08ec780. 00000100:00000001:0.0:1787719747.880564:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1787719747.880566:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.880569:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.880572:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719747.880577:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880586:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719747.880588:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.880590:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719747.880592:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719747.880594:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719747.880597:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726464:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719747.880600:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719747.880606:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719747.880608:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.880610:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719747.880613:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412a200. 02000000:00000001:0.0:1787719747.880615:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719747.880619:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719747.880621:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a688. 00000400:00000010:0.0:1787719747.880625:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5aaa0. 00000100:00000200:0.0:1787719747.880628:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726464, portal 10 00000100:00000001:0.0:1787719747.880630:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719747.880631:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442903040 : -104986266648576 : ffffa083fadec000) 00000100:00000040:0.0:1787719747.880638:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880646:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719747.880649:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719747.880651:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a3b8. 00000100:00000200:0.0:1787719747.880653:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075726464, offset 0 00000400:00000200:0.0:1787719747.880658:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719747.880661:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.880666:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719747.880669:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719747.880671:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719747.880674:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719747.880676:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719747.880679:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540712:540712:255:4294967295] 192.168.204.155@tcp LPNI seq info [540647:540647:7:4294967295] 00000400:00000200:0.0:1787719747.880684:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.880691:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719747.880696:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719747.880700:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa082d58ed800. 00000800:00000200:0.0:1787719747.880704:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719747.880709:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719747.880712:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa082d58ed800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719747.880857:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.880862:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: using a timeout of 24060 usecs (25 jiffies) 00000400:00000200:0.0:1787719747.880866:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719747.880868:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307223081 00000100:00000001:0.0:1787719747.880871:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.880874:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307223081 00000100:00000001:0.0:1787719747.880877:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.880879:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000800:00000200:3.0:1787719747.880882:0:2392:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000100:00000001:0.0:1787719747.880890:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.880895:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000800:00000010:3.0:1787719747.880897:0:2392:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa082d58ed500. 00000100:00000001:0.0:1787719747.880899:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.880905:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:0.0:1787719747.880908:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719747.880911:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000400:00000200:3.0:1787719747.880914:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:0.0:1787719747.880916:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719747.880919:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719747.880921:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1787719747.880922:0:2392:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a6e8 00000100:00100000:0.0:1787719747.880925:0:2399:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000400:00000010:3.0:1787719747.880926:0:2392:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a6e8. 00000100:00000001:0.0:1787719747.880929:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1787719747.880933:0:2392:0:(events.c:34:request_out_callback()) Process entered 00000100:00000001:0.0:1787719747.880933:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719747.880935:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.880938:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000200:3.0:1787719747.880940:0:2392:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880941:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719747.880943:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719747.880951:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.880957:0:2392:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000001:0.0:1787719747.880963:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000040:3.0:1787719747.880964:0:2392:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.880966:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.880968:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719747.880970:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719747.880974:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719747.880981:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726336:192.168.204.155@tcp:400:kworker.0 00000100:00000001:3.0:1787719747.880987:0:2392:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.880987:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00000001:3.0:1787719747.880991:0:2392:0:(events.c:68:request_out_callback()) Process leaving 02000000:00000001:0.0:1787719747.880992:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719747.881001:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.881003:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719747.881007:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412be00. 02000000:00000001:0.0:1787719747.881009:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1787719747.881013:0:2392:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000400:00000200:0.0:1787719747.881013:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000800:00000010:3.0:1787719747.881018:0:2392:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa082d58ed800. 00000400:00000010:0.0:1787719747.881019:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a840. 00000400:00000200:3.0:1787719747.881024:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:0.0:1787719747.881025:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5a7f8. 00000100:00000200:0.0:1787719747.881030:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726336, portal 10 00000400:00000200:3.0:1787719747.881033:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:0.0:1787719747.881034:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719747.881037:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442904832 : -104986266646784 : ffffa083fadec700) 00000400:00000200:3.0:1787719747.881039:0:2392:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a3b8 00000400:00000010:3.0:1787719747.881043:0:2392:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a3b8. 00000100:00000040:0.0:1787719747.881046:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.881047:0:2392:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1787719747.881055:0:2392:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.881059:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719747.881066:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719747.881069:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5acc0. 00000100:00000001:3.0:1787719747.881071:0:2392:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000200:0.0:1787719747.881073:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075726336, offset 0 00000100:00000040:3.0:1787719747.881078:0:2392:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1787719747.881081:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719747.881108:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.881113:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719747.881116:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719747.881119:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719747.881122:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719747.881124:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719747.881128:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540713:540713:255:4294967295] 192.168.204.155@tcp LPNI seq info [540648:540648:7:4294967295] 00000400:00000200:0.0:1787719747.881133:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:3.0:1787719747.881141:0:2392:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719747.881144:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000100:00000001:3.0:1787719747.881145:0:2392:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1787719747.881152:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719747.881156:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa082d58edc00. 00000800:00000200:0.0:1787719747.881160:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719747.881166:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719747.881169:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa082d58edc00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719747.881187:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.881191:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: using a timeout of 27147 usecs (28 jiffies) 00000400:00000200:0.0:1787719747.881194:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719747.881196:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307223085 00000100:00000001:0.0:1787719747.881199:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.881201:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307223085 00000100:00000001:0.0:1787719747.881204:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.881206:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.881208:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.881210:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1787719747.881215:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.881222:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1787719747.881224:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.881227:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1787719747.881229:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1787719747.881231:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1787719747.881235:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726592:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719747.881238:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1787719747.881241:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1787719747.881242:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.881244:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1787719747.881247:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083f412a000. 02000000:00000001:0.0:1787719747.881250:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1787719747.881254:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:0.0:1787719747.881256:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f3a9a210. 00000400:00000010:0.0:1787719747.881260:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5ab28. 00000100:00000200:0.0:1787719747.881263:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726592, portal 4 00000100:00000001:0.0:1787719747.881265:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1787719747.881267:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442906624 : -104986266644992 : ffffa083fadece00) 00000100:00000040:0.0:1787719747.881274:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.881286:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1787719747.881289:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:0.0:1787719747.881291:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083d0b5ac38. 00000100:00000200:0.0:1787719747.881295:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1874547075726592, offset 0 00000400:00000200:0.0:1787719747.881300:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:0.0:1787719747.881304:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.881308:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:0.0:1787719747.881311:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1787719747.881314:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:0.0:1787719747.881316:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1787719747.881319:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:0.0:1787719747.881323:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540714:540714:255:4294967295] 192.168.204.155@tcp LPNI seq info [540649:540649:7:4294967295] 00000400:00000200:0.0:1787719747.881328:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:0.0:1787719747.881336:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:0.0:1787719747.881341:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:0.0:1787719747.881345:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa082d58ed800. 00000800:00000200:0.0:1787719747.881350:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:0.0:1787719747.881355:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:0.0:1787719747.881357:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa082d58ed800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1787719747.881361:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.881364:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: using a timeout of 167130 usecs (168 jiffies) 00000400:00000200:0.0:1787719747.881367:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:0.0:1787719747.881370:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307223225 00000100:00000001:0.0:1787719747.881372:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.881374:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307223225 00000100:00000001:0.0:1787719747.881376:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307226839 00000100:00000001:0.0:1787719747.881378:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.881380:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.881386:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.881389:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.881399:0:2398:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719747.881402:0:2398:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1787719747.882451:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719747.882459:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa082d58edc00. 00000400:00000200:2.0:1787719747.882465:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719747.882471:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719747.882477:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5acc0 00000400:00000010:2.0:1787719747.882479:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5acc0. 00000100:00000001:2.0:1787719747.882483:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719747.882489:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719747.882499:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719747.882502:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719747.882509:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719747.882511:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719747.882538:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719747.882541:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa082d58ed800. 00000400:00000200:2.0:1787719747.882544:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719747.882547:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719747.882550:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5ac38 00000400:00000010:2.0:1787719747.882551:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5ac38. 00000100:00000001:2.0:1787719747.882554:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719747.882557:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719747.882564:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719747.882567:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719747.882573:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719747.882597:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1787719747.897046:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897061:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719747.897065:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897068:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897076:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897084:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719747.897106:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897111:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897116:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897120:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 25 MB=0x6a8e400903b80 00000400:00000200:3.0:1787719747.897125:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897131:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.155@tcp of length 224/224 into md 0x510465 [1] + 224 00000800:00000001:3.0:1787719747.897137:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897141:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897145:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719747.897150:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719747.897169:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719747.897177:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719747.897188:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.897208:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719747.897216:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897220:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719747.897221:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897223:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897230:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897234:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719747.897238:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897241:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897243:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897246:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903c00 00000400:00000200:3.0:1787719747.897250:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897254:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x510475 [1] + 224 00000800:00000001:3.0:1787719747.897258:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897260:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897262:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719747.897266:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719747.897268:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719747.897273:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719747.897281:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.897288:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719747.897291:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897293:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719747.897294:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897301:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897304:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897307:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719747.897312:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897314:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897317:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897319:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903c80 00000400:00000200:3.0:1787719747.897322:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897326:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x51046d [1] + 224 00000800:00000001:3.0:1787719747.897329:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897331:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897333:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719747.897336:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719747.897339:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719747.897344:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719747.897352:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.897359:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719747.897362:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897364:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719747.897365:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897368:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897370:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897373:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719747.897377:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897379:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897381:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897384:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 4 MB=0x6a8e400903d00 00000400:00000200:3.0:1787719747.897388:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719747.897391:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.155@tcp of length 224/224 into md 0x51047d [1] + 224 00000800:00000001:3.0:1787719747.897394:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897403:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719747.897405:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719747.897408:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719747.897411:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719747.897416:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719747.897424:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719747.897431:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719747.897435:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719747.897437:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.900249:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719747.900259:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1787719747.900270:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719747.900272:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719747.900276:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a840. 00000400:00000200:0.0:1787719747.900284:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a7f8 00000400:00000010:0.0:1787719747.900286:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a7f8. 00000100:00000001:0.0:1787719747.900291:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719747.900303:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719747.900315:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.900323:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719747.900326:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.900329:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719747.900332:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719747.900335:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719747.900337:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.900340:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719747.900350:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a62c60 time=139 v=5 (60 60 60 60) 00000100:00001000:0.0:1787719747.900354:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a62c18 time=5 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719747.900357:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719747.900359:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719747.900362:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719747.900365:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.900368:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719747.900370:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffffa083fa1ea800: skip recheck: last_committed 30064771624 00000100:00000001:0.0:1787719747.900372:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719747.900374:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.900379:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.900401:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.900404:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719747.900406:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719747.900411:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719747.900419:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726336:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719747.900426:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719747.900428:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719747.900430:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a210. 00000400:00000200:0.0:1787719747.900433:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5ab28 00000400:00000010:0.0:1787719747.900435:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5ab28. 00000100:00000001:0.0:1787719747.900438:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719747.900442:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719747.900451:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.900457:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719747.900459:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.900460:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719747.900462:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719747.900463:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719747.900465:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.900467:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719747.900471:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083d05acc60 time=139 v=5 (5 5 5 5) 00000100:00001000:0.0:1787719747.900474:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083d05acc18 time=146 v=5 (1 1 0 0) 00000100:00000001:0.0:1787719747.900476:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719747.900478:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719747.900479:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719747.900481:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.900483:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719747.900485:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-ffffa083fa1ea800: skip recheck: last_committed 42949695836 00000100:00000001:0.0:1787719747.900493:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719747.900495:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.900500:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.900506:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.900508:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719747.900510:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719747.900513:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719747.900520:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726592:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719747.900527:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719747.900528:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719747.900530:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9acb8. 00000400:00000200:0.0:1787719747.900533:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5a5d8 00000400:00000010:0.0:1787719747.900535:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5a5d8. 00000100:00000001:0.0:1787719747.900537:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719747.900542:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719747.900551:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.900557:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719747.900558:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.900559:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719747.900561:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719747.900562:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719747.900563:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.900565:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719747.900568:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083c501b460 time=140 v=5 (5 5 5 5) 00000100:00001000:0.0:1787719747.900570:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083c501b418 time=7 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719747.900572:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719747.900573:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719747.900575:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719747.903809:0:2399:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.903822:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.903837:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.903848:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.903851:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719747.903853:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719747.903858:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719747.903866:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075726208:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719747.903879:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719747.903892:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719747.903895:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f3a9a688. 00000400:00000200:0.0:1787719747.903901:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083d0b5aaa0 00000400:00000010:0.0:1787719747.903903:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083d0b5aaa0. 00000100:00000001:0.0:1787719747.903909:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719747.903914:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719747.903924:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.903931:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719747.903933:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.903936:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719747.903939:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719747.903941:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719747.903943:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719747.903946:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719747.903955:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a67460 time=139 v=5 (60 60 60 60) 00000100:00001000:0.0:1787719747.903959:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a67418 time=126 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719747.903961:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719747.903963:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719747.903964:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1787719747.903977:0:2399:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1787719747.903983:0:2399:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.903987:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719747.903988:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffffa083fa1ea800: skip recheck: last_committed 21474836545 00000100:00000001:0.0:1787719747.903990:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719747.903991:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719747.903994:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.904001:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719747.904003:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719747.904004:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719747.904007:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719747.904014:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726464:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719747.904019:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904022:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719747.904026:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadec700 x1874547075726336/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.904032:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719747.904035:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719747.904040:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412be00. 02000000:00000001:0.0:1787719747.904043:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719747.904046:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719747.904048:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a62800 refcount=8 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719747.904050:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719747.904052:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083c3219700. 02000000:00000001:0.0:1787719747.904057:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719747.904059:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719747.904061:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadec700. 00000100:00000001:0.0:1787719747.904064:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719747.904070:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904072:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719747.904078:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadece00 x1874547075726592/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.904084:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719747.904085:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719747.904087:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412a000. 02000000:00000001:0.0:1787719747.904105:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719747.904108:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719747.904109:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083d05ac800 refcount=3 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000020:00000001:0.0:1787719747.904111:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719747.904112:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083c5aef200. 02000000:00000001:0.0:1787719747.904115:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719747.904116:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719747.904117:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadece00. 00000100:00000001:0.0:1787719747.904120:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719747.904121:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904122:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719747.904126:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadee680 x1874547075726208/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.904132:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719747.904133:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719747.904135:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412a800. 02000000:00000001:0.0:1787719747.904137:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719747.904138:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719747.904139:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083c501b000 refcount=3 obd=MGC192.168.204.155@tcp 00000020:00000001:0.0:1787719747.904141:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719747.904143:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083d804f600. 02000000:00000001:0.0:1787719747.904145:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719747.904146:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719747.904147:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadee680. 00000100:00000001:0.0:1787719747.904149:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719747.904151:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904152:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719747.904155:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadec000 x1874547075726464/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719763 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719747.904170:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719747.904171:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719747.904172:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083f412a200. 02000000:00000001:0.0:1787719747.904175:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719747.904176:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719747.904177:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a67000 refcount=3 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719747.904178:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719747.904180:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083c5aef500. 02000000:00000001:0.0:1787719747.904182:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719747.904183:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719747.904184:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadec000. 00000100:00000001:0.0:1787719747.904186:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719747.904187:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904190:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719747.904197:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719747.904199:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719747.904202:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719747.904204:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719748.122362:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719748.122369:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719748.122386:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719748.122387:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719748.122579:0:251484:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719748.122583:0:251484:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719748.122586:0:251484:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00000001:0.0:1787719748.755230:0:284349:0:(llite_lib.c:4247:ll_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719749.144855:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719749.144874:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719749.144884:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719749.144885:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1787719749.146052:0:241647:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1787719749.146058:0:241647:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1787719749.146062:0:241647:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719750.168181:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719750.168297:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719750.168305:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719750.168306:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719750.170581:0:247359:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719750.170589:0:247359:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719750.170594:0:247359:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719751.193760:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719751.193768:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719751.193774:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719751.193775:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719751.193854:0:235674:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719751.193859:0:235674:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719751.193862:0:235674:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1787719751.704220:0:282307:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092ba20 (cpu 2) has reached its deadline 4307226839, at 4307226880 00000100:00000010:2.0:1787719751.704238:0:282307:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083d08ecb40. 00000100:00000040:3.0:1787719751.705318:0:253293:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092bb30 (cpu 3) has reached its deadline 4307226839, at 4307226881 00000100:00000010:3.0:1787719751.705331:0:253293:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083d08ec780. 00010000:00000001:1.0:1787719752.216286:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719752.216296:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719752.216304:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719752.216306:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1787719752.219084:0:235673:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1787719752.219129:0:235673:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1787719752.219133:0:235673:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1787719752.984215:0:271305:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719752.984228:0:271305:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719752.984239:0:271305:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadedc00. 00000020:00000040:1.0:1787719752.984247:0:271305:0:(genops.c:1210:class_import_get()) import ffffa083c501b000 refcount=4 obd=MGC192.168.204.155@tcp 00000100:00000001:1.0:1787719752.984251:0:271305:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719752.984255:0:271305:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719752.984261:0:271305:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719752.984271:0:271305:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083e0afcd00. 00000100:00000001:1.0:1787719752.984280:0:271305:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984296:0:271305:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging dd550a87-676b-4561-a62c-00fc5f0d06d7->MGS req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719752.984308:0:271305:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719752.984315:0:271305:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984322:0:271305:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008036c056] to pc [ptlrpcd_00_01+1] req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984354:0:271305:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984365:0:271305:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719752.984369:0:271305:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719752.984372:0:271305:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadec380. 00000020:00000040:1.0:1787719752.984375:0:271305:0:(genops.c:1210:class_import_get()) import ffffa083f3a62800 refcount=9 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000100:00000001:1.0:1787719752.984378:0:271305:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719752.984379:0:271305:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719752.984381:0:271305:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719752.984384:0:271305:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083e0afca00. 00000100:00000001:1.0:1787719752.984388:0:271305:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984392:0:271305:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0000_UUID req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719752.984399:0:271305:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719752.984401:0:271305:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984404:0:271305:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006143c393] to pc [ptlrpcd_00_00+0] req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984412:0:271305:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984415:0:271305:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719752.984418:0:271305:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719752.984420:0:271305:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083faded500. 00000020:00000040:1.0:1787719752.984422:0:271305:0:(genops.c:1210:class_import_get()) import ffffa083f3a67000 refcount=4 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000100:00000001:1.0:1787719752.984425:0:271305:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719752.984426:0:271305:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719752.984427:0:271305:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719752.984430:0:271305:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083e0afc800. 00000100:00000001:1.0:1787719752.984433:0:271305:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984436:0:271305:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-MDT0001_UUID req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719752.984443:0:271305:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719752.984444:0:271305:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984448:0:271305:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d9a84e1d] to pc [ptlrpcd_00_01+1] req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984465:0:271305:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984467:0:271305:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1787719752.984471:0:271305:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1787719752.984474:0:271305:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffffa083fadec000. 00000020:00000040:1.0:1787719752.984476:0:271305:0:(genops.c:1210:class_import_get()) import ffffa083d05ac800 refcount=4 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000100:00000001:1.0:1787719752.984479:0:271305:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1787719752.984480:0:271305:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1787719752.984482:0:271305:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1787719752.984485:0:271305:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffffa083e0afc000. 00000100:00000001:1.0:1787719752.984488:0:271305:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984492:0:271305:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0000_UUID req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1787719752.984499:0:271305:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1787719752.984501:0:271305:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984504:0:271305:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004c0c8350] to pc [ptlrpcd_00_00+0] req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984511:0:271305:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.984513:0:271305:0:(pinger.c:229:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1787719752.984517:0:271305:0:(pinger.c:247:ptlrpc_pinger_process_import()) fe9d9165-bf6a-4225-8550-dfffafa2b0ed->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1787719752.984522:0:271305:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (12565) 00000100:00000001:1.0:1787719752.984538:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1787719752.984542:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1787719752.984545:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1787719752.984551:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984558:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1787719752.984560:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.984566:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1787719752.984568:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1787719752.984577:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1787719752.984582:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075726720:192.168.204.155@tcp:400:kworker.0 00000100:00000001:1.0:1787719752.984587:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1787719752.984678:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1787719752.984682:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.984685:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1787719752.984692:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083cdc04400. 02000000:00000001:1.0:1787719752.984694:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1787719752.984704:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:1.0:1787719752.984709:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f4f2f000. 00000400:00000010:1.0:1787719752.984718:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4d908. 00000100:00000200:1.0:1787719752.984728:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726720, portal 25 00000100:00000001:1.0:1787719752.984730:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1787719752.984732:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442910208 : -104986266641408 : ffffa083fadedc00) 00000100:00000040:1.0:1787719752.984739:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.984747:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1787719752.984751:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:1.0:1787719752.984754:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4d550. 00000100:00000200:1.0:1787719752.984758:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1874547075726720, offset 0 00000400:00000200:1.0:1787719752.984765:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:1.0:1787719752.984777:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.984796:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:1.0:1787719752.984804:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1787719752.984809:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:1.0:1787719752.984814:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1787719752.984818:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:1.0:1787719752.984822:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540715:540715:256:4294967295] 192.168.204.155@tcp LPNI seq info [540650:540650:8:4294967295] 00000400:00000200:1.0:1787719752.984827:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.984977:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:1.0:1787719752.984985:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:1.0:1787719752.984996:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e0afce00. 00000800:00000200:1.0:1787719752.985005:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:1.0:1787719752.985015:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:1.0:1787719752.985020:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e0afce00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1787719752.985112:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1787719752.985118:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:1.0:1787719752.985121:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 2 is 4307231943 00000100:00000010:1.0:1787719752.985137:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083f43b7d80. 00000100:00000001:1.0:1787719752.985145:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1787719752.985150:0:2399:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS new deadline estimation for cpu 3 is 4307231943 00000100:00000010:1.0:1787719752.985153:0:2399:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffffa083f43b73c0. 00000100:00000001:1.0:1787719752.985156:0:2399:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.204.155@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1787719752.985159:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1787719752.985162:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985164:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1787719752.985168:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985174:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1787719752.985176:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985178:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1787719752.985180:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1787719752.985182:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1787719752.985185:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083faded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726976:192.168.204.155@tcp:400:kworker.0 00000100:00000001:1.0:1787719752.985188:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1787719752.985191:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1787719752.985193:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985195:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1787719752.985198:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083cdc04a00. 02000000:00000001:1.0:1787719752.985200:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1787719752.985204:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:1.0:1787719752.985207:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f4f2f948. 00000400:00000010:1.0:1787719752.985210:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4d110. 00000100:00000200:1.0:1787719752.985219:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726976, portal 10 00000100:00000001:1.0:1787719752.985221:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1787719752.985222:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442908416 : -104986266643200 : ffffa083faded500) 00000100:00000040:1.0:1787719752.985229:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985236:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1787719752.985238:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:1.0:1787719752.985240:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4dc38. 00000100:00000200:1.0:1787719752.985242:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075726976, offset 0 00000400:00000200:1.0:1787719752.985247:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985251:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985254:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:1.0:1787719752.985257:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1787719752.985260:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:1.0:1787719752.985262:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1787719752.985264:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985267:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540716:540716:255:4294967295] 192.168.204.155@tcp LPNI seq info [540651:540651:7:4294967295] 00000400:00000200:1.0:1787719752.985271:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985276:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:1.0:1787719752.985280:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:1.0:1787719752.985283:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e0afc400. 00000800:00000200:1.0:1787719752.985287:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:1.0:1787719752.985292:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:1.0:1787719752.985294:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e0afc400 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1787719752.985297:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.985302:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: using a timeout of 24061 usecs (25 jiffies) 00000400:00000200:1.0:1787719752.985305:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:1.0:1787719752.985307:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307228185 00000100:00000001:1.0:1787719752.985310:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985312:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307228185 00000100:00000001:1.0:1787719752.985320:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985322:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1787719752.985325:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985328:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985331:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1787719752.985342:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1787719752.985344:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1787719752.985348:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1787719752.985349:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1787719752.985351:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1787719752.985354:0:2399:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000001:1.0:1787719752.985356:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1787719752.985358:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1787719752.985359:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1787719752.985361:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1787719752.985362:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1787719752.985363:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1787719752.985369:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985376:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1787719752.985377:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985380:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1787719752.985381:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1787719752.985383:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1787719752.985386:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726848:192.168.204.155@tcp:400:kworker.0 00000100:00000001:1.0:1787719752.985390:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1787719752.985393:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1787719752.985394:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985396:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1787719752.985400:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083cdc04200. 02000000:00000001:1.0:1787719752.985402:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1787719752.985405:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:1.0:1787719752.985408:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f4f2f108. 00000400:00000010:1.0:1787719752.985412:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4dcc0. 00000100:00000200:1.0:1787719752.985415:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075726848, portal 10 00000100:00000001:1.0:1787719752.985423:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1787719752.985424:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442903936 : -104986266647680 : ffffa083fadec380) 00000100:00000040:1.0:1787719752.985430:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985436:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1787719752.985438:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:1.0:1787719752.985440:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4db28. 00000100:00000200:1.0:1787719752.985443:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1874547075726848, offset 0 00000400:00000200:1.0:1787719752.985447:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985450:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985453:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:1.0:1787719752.985456:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1787719752.985458:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:1.0:1787719752.985460:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1787719752.985462:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985464:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540717:540717:254:4294967295] 192.168.204.155@tcp LPNI seq info [540652:540652:6:4294967295] 00000400:00000200:1.0:1787719752.985468:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985473:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:1.0:1787719752.985477:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:1.0:1787719752.985481:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e0afc700. 00000800:00000200:1.0:1787719752.985485:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:1.0:1787719752.985489:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:1.0:1787719752.985492:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e0afc700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1787719752.985495:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.985498:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: using a timeout of 27147 usecs (28 jiffies) 00000400:00000200:1.0:1787719752.985501:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:1.0:1787719752.985503:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307228188 00000100:00000001:1.0:1787719752.985506:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985507:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307228188 00000100:00000001:1.0:1787719752.985510:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-mdc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985519:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1787719752.985521:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985522:0:2399:0:(client.c:1813:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1787719752.985528:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985535:0:2399:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1787719752.985536:0:2399:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985538:0:2399:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1787719752.985540:0:2399:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1787719752.985542:0:2399:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1787719752.985545:0:2399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa083fadec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075727104:192.168.204.155@tcp:400:kworker.0 00000100:00000001:1.0:1787719752.985548:0:2399:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1787719752.985551:0:2399:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1787719752.985553:0:2399:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1787719752.985555:0:2399:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1787719752.985560:0:2399:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffffa083d8173000. 02000000:00000001:1.0:1787719752.985561:0:2399:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1787719752.985565:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000010:1.0:1787719752.985568:0:2399:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffffa083f4f2f688. 00000400:00000010:1.0:1787719752.985572:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4d3b8. 00000100:00000200:1.0:1787719752.985575:0:2399:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1874547075727104, portal 4 00000100:00000001:1.0:1787719752.985576:0:2399:0:(client.c:3275:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1787719752.985578:0:2399:0:(client.c:3277:ptlrpc_request_addref()) Process leaving (rc=18446639087442903040 : -104986266648576 : ffffa083fadec000) 00000100:00000040:1.0:1787719752.985584:0:2399:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1787719752.985603:0:2399:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1787719752.985605:0:2399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.155@tcp 00000400:00000010:1.0:1787719752.985608:0:2399:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffffa083f9a4d330. 00000100:00000200:1.0:1787719752.985611:0:2399:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1874547075727104, offset 0 00000400:00000200:1.0:1787719752.985615:0:2399:0:(lib-move.c:5157:LNetPut()) LNetPut -> 12345-192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985618:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985621:0:2399:0:(lib-move.c:2813:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.155@tcp local destination 00000400:00000200:1.0:1787719752.985629:0:2399:0:(lib-move.c:2444:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1787719752.985632:0:2399:0:(lib-move.c:1625:lnet_get_best_ni()) selected best_ni 192.168.204.55@tcp 00000400:00000200:1.0:1787719752.985634:0:2399:0:(lib-move.c:1178:lnet_select_peer_ni()) 192.168.204.55@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1787719752.985636:0:2399:0:(lib-move.c:1247:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.155@tcp 00000400:00000200:1.0:1787719752.985638:0:2399:0:(lib-move.c:1745:lnet_handle_send()) 192.168.204.55@tcp NI seq info: [540718:540718:253:4294967295] 192.168.204.155@tcp LPNI seq info [540653:540653:5:4294967295] 00000400:00000200:1.0:1787719752.985642:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:1.0:1787719752.985648:0:2399:0:(lib-move.c:1861:lnet_handle_send()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp:) -> 192.168.204.155@tcp(192.168.204.155@tcp:192.168.204.155@tcp) : PUT try# 0 00000800:00000200:1.0:1787719752.985652:0:2399:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.155@tcp 00000800:00000010:1.0:1787719752.985656:0:2399:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffffa083e0afcf00. 00000800:00000200:1.0:1787719752.985659:0:2399:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffffa083d1333600] -> 12345-192.168.204.155@tcp (5) 00000800:00000200:1.0:1787719752.985663:0:2399:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.155@tcp ip 192.168.204.155:988 00000800:00000200:1.0:1787719752.985666:0:2399:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffffa083e0afcf00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1787719752.985668:0:2399:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1787719752.985672:0:2399:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: using a timeout of 167030 usecs (168 jiffies) 00000400:00000200:1.0:1787719752.985674:0:2399:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000100:00000001:1.0:1787719752.985676:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 2 is 4307228328 00000100:00000001:1.0:1787719752.985679:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 2, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985681:0:2399:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS new deadline estimation for cpu 3 is 4307228328 00000100:00000001:1.0:1787719752.985683:0:2399:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-ffffa083fa1ea800: PM QoS request active for cpu 3, keep current deadline 4307231943 00000100:00000001:1.0:1787719752.985684:0:2399:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1787719752.985686:0:2399:0:(client.c:1941:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985689:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985691:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1787719752.985707:0:2398:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1787719752.985710:0:2398:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1787719752.995154:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719752.995168:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e0afce00. 00000400:00000200:2.0:1787719752.995176:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719752.995187:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719752.995196:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4d550 00000400:00000010:2.0:1787719752.995199:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4d550. 00000100:00000001:2.0:1787719752.995206:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719752.995217:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995231:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719752.995235:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995255:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719752.995257:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719752.995275:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719752.995277:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e0afc400. 00000400:00000200:2.0:1787719752.995280:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719752.995284:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719752.995287:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4dc38 00000400:00000010:2.0:1787719752.995288:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4dc38. 00000100:00000001:2.0:1787719752.995291:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719752.995295:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995303:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719752.995306:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995312:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719752.995322:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719752.995330:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719752.995332:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e0afc700. 00000400:00000200:2.0:1787719752.995335:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719752.995338:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719752.995341:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4db28 00000400:00000010:2.0:1787719752.995343:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4db28. 00000100:00000001:2.0:1787719752.995345:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719752.995349:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995358:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719752.995360:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995367:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719752.995368:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1787719752.995394:0:2393:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1787719752.995396:0:2393:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffffa083e0afcf00. 00000400:00000200:2.0:1787719752.995400:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719752.995403:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000400:00000200:2.0:1787719752.995405:0:2393:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4d330 00000400:00000010:2.0:1787719752.995408:0:2393:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4d330. 00000100:00000001:2.0:1787719752.995410:0:2393:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1787719752.995415:0:2393:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995422:0:2393:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1787719752.995425:0:2393:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719752.995431:0:2393:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1787719752.995433:0:2393:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1787719753.006980:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007004:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719753.007009:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007012:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719753.007023:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007033:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719753.007045:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007051:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007058:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007063:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 4 MB=0x6a8e400903f00 00000400:00000200:3.0:1787719753.007070:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007078:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.155@tcp of length 224/224 into md 0x51049d [1] + 224 00000800:00000001:3.0:1787719753.007086:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007142:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719753.007146:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719753.007152:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719753.007162:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719753.007174:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719753.007187:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719753.007208:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719753.007222:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007226:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1787719753.007228:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007231:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719753.007234:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007239:0:2392:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:3.0:1787719753.007243:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007246:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007249:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007251:0:2392:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 25 MB=0x6a8e400903d80 00000400:00000200:3.0:1787719753.007256:0:2392:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:3.0:1787719753.007261:0:2392:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.155@tcp of length 224/224 into md 0x510485 [1] + 224 00000800:00000001:3.0:1787719753.007265:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007272:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1787719753.007274:0:2392:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1787719753.007277:0:2392:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:3.0:1787719753.007281:0:2392:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1787719753.007286:0:2392:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787719753.007295:0:2392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1787719753.007302:0:2392:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1787719753.007314:0:2392:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:3.0:1787719753.007318:0:2392:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.007451:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719753.007459:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1787719753.007470:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719753.007473:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719753.007477:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f4f2f688. 00000400:00000200:0.0:1787719753.007483:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4d3b8 00000400:00000010:0.0:1787719753.007486:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4d3b8. 00000100:00000001:0.0:1787719753.007490:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719753.007495:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719753.007504:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007518:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719753.007521:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.007523:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719753.007528:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719753.007530:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719753.007533:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719753.007537:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719753.007549:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083d05acc60 time=145 v=5 (5 5 5 5) 00000100:00001000:0.0:1787719753.007555:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083d05acc18 time=152 v=5 (1 1 0 0) 00000100:00000001:0.0:1787719753.007557:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719753.007560:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719753.007563:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719753.007568:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.007572:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719753.007575:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-ffffa083fa1ea800: skip recheck: last_committed 42949695836 00000100:00000001:0.0:1787719753.007577:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719753.007579:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719753.007585:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007592:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719753.007595:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719753.007598:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719753.007602:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719753.007611:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075727104:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719753.007618:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719753.007619:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719753.007621:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f4f2f000. 00000400:00000200:0.0:1787719753.007624:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4d908 00000400:00000010:0.0:1787719753.007626:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4d908. 00000100:00000001:0.0:1787719753.007628:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719753.007639:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719753.007647:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007653:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719753.007655:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.007657:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719753.007658:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719753.007659:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719753.007661:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719753.007663:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719753.007666:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083c501b460 time=146 v=5 (5 5 5 5) 00000100:00001000:0.0:1787719753.007669:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083c501b418 time=13 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719753.007672:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719753.007673:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719753.007675:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719753.007677:0:2399:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.007679:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719753.007683:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007689:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719753.007691:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719753.007693:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719753.007696:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719753.007703:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd550a87-676b-4561-a62c-00fc5f0d06d7:2399:1874547075726720:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719753.007709:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.007712:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719753.007716:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadec000 x1874547075727104/t0(0) o400->lustre-OST0000-osc-ffffa083fa1ea800@192.168.204.155@tcp:28/4 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007723:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719753.007732:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719753.007737:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083d8173000. 02000000:00000001:0.0:1787719753.007741:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719753.007745:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719753.007747:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083d05ac800 refcount=3 obd=lustre-OST0000-osc-ffffa083fa1ea800 00000020:00000001:0.0:1787719753.007750:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719753.007753:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083e0afc000. 02000000:00000001:0.0:1787719753.007758:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719753.007760:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719753.007763:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadec000. 00000100:00000001:0.0:1787719753.007767:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719753.007768:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.007770:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719753.007774:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadedc00 x1874547075726720/t0(0) o400->MGC192.168.204.155@tcp@192.168.204.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.007780:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719753.007781:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719753.007783:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083cdc04400. 02000000:00000001:0.0:1787719753.007796:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719753.007797:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719753.007799:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083c501b000 refcount=3 obd=MGC192.168.204.155@tcp 00000020:00000001:0.0:1787719753.007801:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719753.007802:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083e0afcd00. 02000000:00000001:0.0:1787719753.007805:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719753.007806:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719753.007807:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadedc00. 00000100:00000001:0.0:1787719753.007809:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719753.007811:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.007814:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.007816:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719753.007818:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1787719753.007820:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.007821:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:2.0:1787719753.020616:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020648:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1787719753.020653:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020656:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719753.020689:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020699:0:2393:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:2.0:1787719753.020711:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020717:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020724:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020728:0:2393:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903e80 00000400:00000200:2.0:1787719753.020734:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020740:0:2393:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x51048d [1] + 224 00000800:00000001:2.0:1787719753.020749:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020754:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719753.020758:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719753.020764:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:2.0:1787719753.020774:0:2393:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719753.020798:0:2393:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787719753.020812:0:2393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719753.020828:0:2393:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1787719753.020841:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020845:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1787719753.020846:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020849:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719753.020852:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020856:0:2393:0:(lib-move.c:4652:lnet_parse()) TRACE: 192.168.204.55@tcp(192.168.204.55@tcp) <- 192.168.204.155@tcp : PUT - for me 00000400:00000200:2.0:1787719753.020860:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020863:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020866:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020869:0:2393:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.204.155@tcp of length 224 into portal 10 MB=0x6a8e400903e00 00000400:00000200:2.0:1787719753.020872:0:2393:0:(api-ni.c:1613:lnet_nid4_cpt_hash()) Match nid 192.168.204.155@tcp to cpt 1 00000400:00000200:2.0:1787719753.020876:0:2393:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.155@tcp of length 224/224 into md 0x510495 [1] + 224 00000800:00000001:2.0:1787719753.020880:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020912:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1787719753.020915:0:2393:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1787719753.020919:0:2393:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.204.55@tcp->192.168.204.155@tcp: PUT: OK 00000100:00000001:2.0:1787719753.020924:0:2393:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1787719753.020930:0:2393:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787719753.020939:0:2393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1787719753.020947:0:2393:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1787719753.020951:0:2393:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:2.0:1787719753.020954:0:2393:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021298:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719753.021305:0:2399:0:(client.c:1990:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1787719753.021314:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719753.021316:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719753.021321:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f4f2f108. 00000400:00000200:0.0:1787719753.021334:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4dcc0 00000400:00000010:0.0:1787719753.021337:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4dcc0. 00000100:00000001:0.0:1787719753.021340:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719753.021346:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719753.021355:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021362:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719753.021365:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021367:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719753.021372:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719753.021375:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719753.021379:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719753.021383:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719753.021396:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a62c60 time=145 v=5 (60 60 60 60) 00000100:00001000:0.0:1787719753.021401:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a62c18 time=11 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719753.021404:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719753.021406:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719753.021409:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1787719753.021413:0:2399:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.021418:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719753.021421:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffffa083fa1ea800: skip recheck: last_committed 30064771624 00000100:00000001:0.0:1787719753.021423:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719753.021425:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719753.021431:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021439:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719753.021442:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719753.021445:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719753.021449:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719753.021457:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083fadec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726848:192.168.204.155@tcp:400:kworker.0 00000400:00000001:0.0:1787719753.021474:0:2399:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1787719753.021475:0:2399:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1787719753.021477:0:2399:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffffa083f4f2f948. 00000400:00000200:0.0:1787719753.021479:0:2399:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffffa083f9a4d110 00000400:00000010:0.0:1787719753.021481:0:2399:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffffa083f9a4d110. 00000100:00000001:0.0:1787719753.021483:0:2399:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1787719753.021487:0:2399:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1787719753.021495:0:2399:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021501:0:2399:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1787719753.021502:0:2399:0:(client.c:3001:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021504:0:2399:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1787719753.021506:0:2399:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1787719753.021507:0:2399:0:(pack_generic.c:605:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1787719753.021509:0:2399:0:(pack_generic.c:623:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1787719753.021510:0:2399:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1787719753.021515:0:2399:0:(import.c:2149:obd_at_measure()) add 5 to ffffa083f3a67460 time=145 v=5 (60 60 60 60) 00000100:00001000:0.0:1787719753.021519:0:2399:0:(import.c:2149:obd_at_measure()) add 1 to ffffa083f3a67418 time=132 v=5 (1 1 1 1) 00000100:00000001:0.0:1787719753.021521:0:2399:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1787719753.021523:0:2399:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1787719753.021525:0:2399:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1787719753.021528:0:2399:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1787719753.021535:0:2399:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.021538:0:2399:0:(client.c:3109:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1787719753.021539:0:2399:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffffa083fa1ea800: skip recheck: last_committed 21474836545 00000100:00000001:0.0:1787719753.021541:0:2399:0:(client.c:3122:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1787719753.021542:0:2399:0:(client.c:1797:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1787719753.021546:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021552:0:2399:0:(client.c:2354:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1787719753.021560:0:2399:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1787719753.021562:0:2399:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1787719753.021566:0:2399:0:(lustre_net.h:2405:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787719753.021574:0:2399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa083faded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fe9d9165-bf6a-4225-8550-dfffafa2b0ed:2399:1874547075726976:192.168.204.155@tcp:400:kworker.0 00000100:00000001:0.0:1787719753.021578:0:2399:0:(client.c:2465:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021581:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719753.021585:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083fadec380 x1874547075726848/t0(0) o400->lustre-MDT0000-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021591:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719753.021594:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719753.021599:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083cdc04200. 02000000:00000001:0.0:1787719753.021603:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719753.021607:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719753.021609:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a62800 refcount=8 obd=lustre-MDT0000-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719753.021611:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719753.021615:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083e0afca00. 02000000:00000001:0.0:1787719753.021620:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719753.021621:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719753.021624:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083fadec380. 00000100:00000001:0.0:1787719753.021627:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719753.021629:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021630:0:2399:0:(client.c:2867:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1787719753.021634:0:2399:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffffa083faded500 x1874547075726976/t0(0) o400->lustre-MDT0001-mdc-ffffa083fa1ea800@192.168.204.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1787719768 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1787719753.021639:0:2399:0:(client.c:2793:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1787719753.021641:0:2399:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1787719753.021642:0:2399:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffffa083cdc04a00. 02000000:00000001:0.0:1787719753.021644:0:2399:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1787719753.021645:0:2399:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1787719753.021646:0:2399:0:(genops.c:1223:class_import_put()) import ffffa083f3a67000 refcount=3 obd=lustre-MDT0001-mdc-ffffa083fa1ea800 00000020:00000001:0.0:1787719753.021648:0:2399:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1787719753.021649:0:2399:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffffa083e0afc800. 02000000:00000001:0.0:1787719753.021660:0:2399:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1787719753.021661:0:2399:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1787719753.021662:0:2399:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffffa083faded500. 00000100:00000001:0.0:1787719753.021665:0:2399:0:(client.c:2849:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1787719753.021666:0:2399:0:(client.c:2908:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021669:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1787719753.021679:0:2399:0:(client.c:2639:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1787719753.021681:0:2399:0:(client.c:2667:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1787719753.021684:0:2399:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1787719753.021686:0:2399:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241411:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719753.241424:0:262853:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:1.0:1787719753.241427:0:262853:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:1.0:1787719753.241431:0:262853:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241437:0:262853:0:(ldlm_lockd.c:2378:ldlm_bl_to_thread()) Process entered 00010000:00000001:1.0:1787719753.241440:0:262853:0:(ldlm_lockd.c:2381:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241459:0:262853:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241462:0:262853:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241468:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719753.241470:0:262853:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:1.0:1787719753.241471:0:262853:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:1.0:1787719753.241478:0:262853:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:1.0:1787719753.241492:0:262853:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:1.0:1787719753.241493:0:262853:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241495:0:262853:0:(ldlm_lockd.c:2378:ldlm_bl_to_thread()) Process entered 00010000:00000001:1.0:1787719753.241496:0:262853:0:(ldlm_lockd.c:2381:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241498:0:262853:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719753.241499:0:262853:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719753.241640:0:251484:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719753.241648:0:251484:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719753.241655:0:251484:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:1.0:1787719754.265341:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719754.265347:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719754.265351:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719754.265353:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1787719754.265775:0:241647:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1787719754.265779:0:241647:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1787719754.265784:0:241647:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00000001:2.0:1787719754.633422:0:284490:0:(llite_lib.c:4247:ll_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719755.288422:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719755.288431:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719755.288450:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719755.288452:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1787719755.288674:0:247359:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1787719755.288679:0:247359:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1787719755.288682:0:247359:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000001:0.0:1787719755.441653:0:284526:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:0.0:1787719755.441663:0:284526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_816: @@@@@@ FAIL: client: import is not in IDLE state after 50 00000001:00000001:0.0:1787719755.458175:0:284526:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00010000:00000001:1.0:1787719756.313697:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719756.313705:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719756.313711:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719756.313712:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1787719756.314647:0:235674:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1787719756.314651:0:235674:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1787719756.314657:0:235674:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1787719756.825626:0:282307:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092ba20 (cpu 2) has reached its deadline 4307231943, at 4307232001 00000100:00000010:2.0:1787719756.825649:0:282307:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083f43b7d80. 00000100:00000040:3.0:1787719756.826133:0:253293:0:(connection.c:75:cpu_latency_work()) work item of ffffa083e092bb30 (cpu 3) has reached its deadline 4307231943, at 4307232001 00000100:00000010:3.0:1787719756.826141:0:253293:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffffa083f43b73c0. 00000080:00000001:1.0:1787719757.253441:0:284626:0:(llite_lib.c:4247:ll_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719757.340235:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719757.340243:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1787719757.340249:0:262853:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:1.0:1787719757.340250:0:262853:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1787719757.340297:0:235673:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1787719757.340301:0:235673:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1787719757.340303:0:235673:0:(ldlm_lockd.c:2946:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2627 lines, 2627 kept, 0 dropped, 0 bad.