00010000:00000001:2.0F:1789498289.293933:0:12525:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1789498289.293950:0:12525:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498289.293958:0:12525:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1789498289.293959:0:12525:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0F:1789498289.294191:0:13099:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789498289.294199:0:13099:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789498289.294203:0:13099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000800:00000200:3.0F:1789498289.487877:0:3295:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff979d4994ef00] -> 12345-192.168.203.48@tcp (4) 00000800:00000200:3.0:1789498289.487901:0:3295:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.203.48@tcp ip 192.168.203.48:1021 00000800:00000200:3.0:1789498289.487931:0:3295:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffff979d58115500 type 192, nob 24 niov 1 nkiov 0 00000800:00000200:1.0F:1789498289.488110:0:3298:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00010000:00000001:2.0:1789498290.317086:0:12525:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1789498290.317098:0:12525:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498290.317107:0:12525:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1789498290.317108:0:12525:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498290.317940:0:13098:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789498290.317950:0:13098:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789498290.317958:0:13098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:2.0:1789498291.341142:0:12525:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1789498291.341149:0:12525:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498291.341155:0:12525:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1789498291.341157:0:12525:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498291.341218:0:13099:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789498291.341221:0:13099:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789498291.341224:0:13099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:3.0:1789498291.550272:0:15639:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1789498291.550351:0:15639:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498291.550359:0:15639:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:3.0:1789498291.550367:0:15639:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1789498291.550372:0:15639:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498291.550377:0:15639:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1789498291.973703:0:15675:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:0.0:1789498291.973710:0:15675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity : @@@@@@ FAIL: mds1: import is not in FULL state after 50 00000001:00000001:0.0:1789498291.981714:0:15675:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00010000:00000001:2.0:1789498292.365045:0:12525:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1789498292.365053:0:12525:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498292.365060:0:12525:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1789498292.365061:0:12525:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498292.365167:0:13098:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789498292.365170:0:13098:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789498292.365173:0:13098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000001:0.0:1789498293.222436:0:15687:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:0.0:1789498293.222453:0:15687:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498293.222461:0:15687:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:0.0:1789498293.222468:0:15687:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:0.0:1789498293.222475:0:15687:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498293.222479:0:15687:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498293.389782:0:12525:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1789498293.389788:0:12525:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498293.389794:0:12525:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1789498293.389796:0:12525:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789498293.394294:0:13099:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789498293.394301:0:13099:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789498293.394306:0:13099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000001:2.0:1789498293.644983:0:14180:0:(osp_precreate.c:196:osp_statfs_update()) Process entered 00000004:00000020:2.0:1789498293.644990:0:14180:0:(osp_precreate.c:198:osp_statfs_update()) going to update statfs 00000100:00000010:2.0:1789498293.645001:0:14180:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d4716b800. 00000020:00000040:2.0:1789498293.645008:0:14180:0:(genops.c:1209:class_import_get()) import ffff979c43218000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000001:2.0:1789498293.645014:0:14180:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1789498293.645017:0:14180:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1789498293.645035:0:14180:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1789498293.645044:0:14180:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff979d7ef7f800. 00000100:00000001:2.0:1789498293.645051:0:14180:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.645057:0:14180:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1789498293.645062:0:14180:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.645072:0:14180:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000056f4f9da] to pc [ptlrpcd_00_03+3] req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00000001:2.0:1789498293.645097:0:14180:0:(osp_precreate.c:256:osp_statfs_update()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.645107:0:3305:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1789498293.645110:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:2.0:1789498293.645113:0:3305:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.645120:0:3305:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789498293.645134:0:3305:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.645136:0:3305:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789498293.645138:0:3305:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1789498293.645141:0:3305:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1789498293.645146:0:3305:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.645153:0:3305:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1789498293.645155:0:3305:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789498293.645159:0:3305:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1789498293.645161:0:3305:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1789498293.645164:0:3305:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.645615:0:3306:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789498293.645620:0:3306:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789498293.646205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f265306-a622-4c44-9fa7-6d84c3fbc1d7->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1789498293.646213:0:37:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00100000:2.0:1789498293.646217:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff979d4716b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876424575226112:0@lo:13:osp-pre-0-0.0 00000100:00000010:3.0:1789498293.646219:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d7f915c00. 00000020:00000040:3.0:1789498293.646226:0:37:0:(genops.c:1209:class_import_get()) import ffff979d6ad11800 refcount=4 obd=MGC192.168.203.148@tcp 00000100:00000001:2.0:1789498293.646226:0:3305:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1789498293.646232:0:3305:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:3.0:1789498293.646233:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1789498293.646236:0:3305:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.646237:0:37:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1789498293.646242:0:3305:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000001:3.0:1789498293.646243:0:37:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1789498293.646250:0:3305:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff979d80b58800. 02000000:00000010:3.0:1789498293.646251:0:37:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff979d775aeb00. 02000000:00000001:2.0:1789498293.646256:0:3305:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.646258:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789498293.646264:0:3305:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff979d7f943210. 00000100:00000040:3.0:1789498293.646267:0:37:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 5f265306-a622-4c44-9fa7-6d84c3fbc1d7->MGS req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000010:2.0:1789498293.646273:0:3305:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d7b091660. 00000100:00000001:3.0:1789498293.646281:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000200:2.0:1789498293.646282:0:3305:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1876424575226112, portal 4 00000100:00000001:3.0:1789498293.646285:0:37:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646287:0:3305:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1789498293.646290:0:3305:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629300491171840 : -114773218379776 : ffff979d4716b800) 00000100:00000040:3.0:1789498293.646293:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000366da814] to pc [ptlrpcd_00_00+0] req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789498293.646300:0:3305:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.646315:0:3305:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789498293.646318:0:3305:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1789498293.646321:0:3305:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d7b091990. 00000100:00000200:2.0:1789498293.646324:0:3305:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1876424575226112, offset 0 00000400:00000200:2.0:1789498293.646330:0:3305:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:3.0:1789498293.646333:0:37:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789498293.646337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1789498293.646340:0:37:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000400:00000200:2.0:1789498293.646345:0:3305:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000010:3.0:1789498293.646346:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d7f914000. 00000020:00000040:3.0:1789498293.646350:0:37:0:(genops.c:1209:class_import_get()) import ffff979d47a04800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:3.0:1789498293.646353:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1789498293.646355:0:37:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000400:00000200:2.0:1789498293.646358:0:3305:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 7 MB=0x6aa9924411100 02000000:00000001:3.0:1789498293.646359:0:37:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789498293.646365:0:3305:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 7 from 12345-0@lo of length 224/224 into md 0x3169 [8] + 3584 02000000:00000010:3.0:1789498293.646373:0:37:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff979d775aef00. 00000100:00000001:3.0:1789498293.646378:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789498293.646379:0:3305:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000040:3.0:1789498293.646385:0:37:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000200:2.0:1789498293.646395:0:3305:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1789498293.646398:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1789498293.646402:0:37:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646404:0:3305:0:(events.c:290:request_in_callback()) Process entered 00000100:00000040:3.0:1789498293.646407:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c4874ae1] to pc [ptlrpcd_00_01+1] req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789498293.646409:0:3305:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost_create 00000100:00000010:2.0:1789498293.646415:0:3305:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d4716bb80. 00000100:00000040:2.0:1789498293.646421:0:3305:0:(events.c:341:request_in_callback()) incoming req@ffff979d4716bb80 x1876424575226112 msgsize 224 00000100:00000001:3.0:1789498293.646423:0:37:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789498293.646429:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1789498293.646429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:3.0:1789498293.646434:0:37:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1789498293.646438:0:37:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d7f914700. 00000100:00000001:2.0:1789498293.646439:0:3305:0:(events.c:377:request_in_callback()) Process leaving 00000020:00000040:3.0:1789498293.646441:0:37:0:(genops.c:1209:class_import_get()) import ffff979d7aa16000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000001:3.0:1789498293.646445:0:37:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1789498293.646447:0:37:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1789498293.646450:0:37:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789498293.646450:0:3305:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d7b091990 00000400:00000010:2.0:1789498293.646454:0:3305:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d7b091990. 02000000:00000010:3.0:1789498293.646457:0:37:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff979d775ae300. 00000100:00000001:2.0:1789498293.646459:0:3305:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:3.0:1789498293.646462:0:37:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1789498293.646465:0:3305:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789498293.646470:0:37:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1789498293.646483:0:3305:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000001:3.0:1789498293.646484:0:37:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1789498293.646489:0:37:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.646489:0:3305:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.646499:0:3305:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646501:0:3305:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000040:3.0:1789498293.646506:0:37:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000056b47bc4] to pc [ptlrpcd_00_02+2] req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.646507:0:3305:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.646514:0:3305:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 19205 usecs (20 jiffies) 00000100:00000001:2.0:1789498293.646520:0:3305:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295121941 00000100:00000001:3.0:1789498293.646526:0:37:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1789498293.646526:0:3305:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff979d50897420. 00000100:00000040:3.0:1789498293.646533:0:37:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (459) 00000100:00000001:2.0:1789498293.646534:0:3305:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:2.0:1789498293.646542:0:3305:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295121941 00000100:00000001:3.0:1789498293.646544:0:3306:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000010:2.0:1789498293.646546:0:3305:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff979d508972a0. 00000100:00100000:3.0:1789498293.646548:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:2.0:1789498293.646551:0:3305:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 1 00000100:00000001:3.0:1789498293.646552:0:3306:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.646556:0:3305:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295121941 00000100:00000010:2.0:1789498293.646560:0:3305:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff979d50897f00. 00000100:00000001:3.0:1789498293.646562:0:3306:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789498293.646564:0:3305:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 2 00000100:00000001:3.0:1789498293.646566:0:3306:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.646568:0:3305:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295121941 00000100:00000001:3.0:1789498293.646571:0:3306:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000010:2.0:1789498293.646573:0:3305:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff979d508978a0. 00000100:00000001:2.0:1789498293.646576:0:3305:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request now active for cpu 3 00000100:00000001:3.0:1789498293.646581:0:3306:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1789498293.646583:0:3306:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000001:2.0:1789498293.646589:0:3305:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:3.0:1789498293.646590:0:3306:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.646594:0:3305:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646600:0:3305:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.646603:0:3306:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1789498293.646605:0:3305:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.646607:0:3306:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646609:0:3305:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789498293.646611:0:3305:0:(client.c:1991:ptlrpc_check_set()) Process entered 02000000:00000001:3.0:1789498293.646612:0:3306:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:2.0:1789498293.646613:0:3305:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.646616:0:3306:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789498293.646617:0:3305:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.646622:0:3306:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789498293.646627:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff979d7f914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424575226496:0@lo:400:kworker.0 00000100:00000001:3.0:1789498293.646631:0:3306:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1789498293.646633:0:3306:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1789498293.646636:0:3306:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.646637:0:3306:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:2.0:1789498293.646638:0:14102:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 02000000:00000010:3.0:1789498293.646641:0:3306:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff979d7a4b7e00. 00000100:00100000:2.0:1789498293.646642:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424575226112 02000000:00000001:3.0:1789498293.646645:0:3306:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789498293.646646:0:14102:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1789498293.646650:0:14102:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000400:00000010:3.0:1789498293.646652:0:3306:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff979d7fa5d3c8. 00000100:00000001:2.0:1789498293.646653:0:14102:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1789498293.646659:0:3306:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d6fc6b330. 02000000:00000001:2.0:1789498293.646660:0:14102:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789498293.646665:0:3306:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424575226496, portal 10 00000100:00100000:2.0:1789498293.646666:0:14102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424575226112 00000100:00000001:3.0:1789498293.646671:0:3306:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000020:00000001:2.0:1789498293.646671:0:14102:0:(genops.c:792:class_conn2export()) Process entered 00000100:00000001:3.0:1789498293.646673:0:3306:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629301438727936 : -114772270823680 : ffff979d7f914700) 00000020:00000040:2.0:1789498293.646676:0:14102:0:(genops.c:804:class_conn2export()) looking for export cookie 0x4eb017502e6dfe76 00000020:00000001:2.0:1789498293.646680:0:14102:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000040:3.0:1789498293.646682:0:3306:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1789498293.646685:0:14102:0:(lustre_handles.c:148:class_handle2object()) GET export ffff979d7aa10000 refcount=5 00000020:00000001:2.0:1789498293.646689:0:14102:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629301355872256 : -114772353679360 : ffff979d7aa10000) 00000020:00000001:2.0:1789498293.646694:0:14102:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629301355872256 : -114772353679360 : ffff979d7aa10000) 00000100:00000001:3.0:1789498293.646696:0:3306:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:2.0:1789498293.646700:0:14102:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:3.0:1789498293.646701:0:3306:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1789498293.646707:0:3306:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d6fc6b198. 00000020:00000010:2.0:1789498293.646707:0:14102:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d7a9a1f80. 00000100:00000200:3.0:1789498293.646711:0:3306:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424575226496, offset 0 00000020:00000010:2.0:1789498293.646714:0:14102:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff979c41ed2f80. 00000400:00000200:3.0:1789498293.646719:0:3306:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000040:2.0:1789498293.646722:0:14102:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff979d7c0119c0) now 6 - evictor 00000400:00000200:3.0:1789498293.646727:0:3306:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1789498293.646731:0:14102:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000400:00000200:3.0:1789498293.646736:0:3306:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9924411280 00000020:00000010:2.0:1789498293.646738:0:14102:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff979d76159600. 00000400:00000200:3.0:1789498293.646744:0:3306:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x2765 [64] + 9624 00000020:00000010:2.0:1789498293.646744:0:14102:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff979d75755d80. 00000020:00000010:2.0:1789498293.646753:0:14102:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff979d580e3898. 00000400:00000200:3.0:1789498293.646754:0:3306:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1789498293.646760:0:3306:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000040:2.0:1789498293.646763:0:14102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000001:2.0:1789498293.646768:0:14102:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1789498293.646770:0:14102:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789498293.646772:0:3306:0:(events.c:290:request_in_callback()) Process entered 00000100:00000001:2.0:1789498293.646773:0:14102:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646781:0:14102:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646787:0:14102:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.646804:0:14102:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789498293.646806:0:14102:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1789498293.646810:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00000040:2.0:1789498293.646813:0:14102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff979d7aa10000 : new rpc_count 1 00000100:00000001:2.0:1789498293.646815:0:14102:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629300491172736 : -114773218378880 : ffff979d4716bb80) 00000100:00000040:2.0:1789498293.646821:0:14102:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff979d4716bb80 x1876424575226112/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:324/0 lens 224/0 e 0 to 0 dl 1789498304 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.646829:0:14102:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1789498293.646831:0:14102:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d7a9a1600. 00000100:00000001:2.0:1789498293.646834:0:14102:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1789498293.646836:0:14102:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d7a9a1600. 00000100:00100000:2.0:1789498293.646840:0:14102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff979d4716bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424575226112:12345-0@lo:13:osp-pre-0-0.0 00000100:00000200:2.0:1789498293.646844:0:14102:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424575226112 00000020:00000001:2.0:1789498293.646848:0:14102:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1789498293.646851:0:14102:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1789498293.646854:0:14102:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.646856:0:14102:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1789498293.646858:0:14102:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072671609264 : -1037942352 : ffffffffc22241b0) 00000020:00000001:2.0:1789498293.646861:0:14102:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1789498293.646864:0:14102:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789498293.646866:0:14102:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1789498293.646868:0:14102:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1789498293.646872:0:14102:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646875:0:14102:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1789498293.646878:0:14102:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1789498293.646882:0:14102:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 664 at ffff979d80b5a800. 02000000:00000001:2.0:1789498293.646884:0:14102:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.646886:0:14102:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00002000:00000001:2.0:1789498293.646889:0:14102:0:(ofd_dev.c:1915:ofd_statfs_hdl()) Process entered 00002000:00000001:2.0:1789498293.646893:0:14102:0:(ofd_obd.c:710:ofd_statfs()) Process entered 00000020:00000001:2.0:1789498293.646895:0:14102:0:(tgt_grant.c:274:tgt_statfs_internal()) Process entered 00080000:00000001:2.0:1789498293.646900:0:14102:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:2.0:1789498293.646931:0:14102:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789498293.646932:0:3306:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:3.0:1789498293.646939:0:3306:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d7f916300. 00000020:00000001:2.0:1789498293.646939:0:14102:0:(tgt_grant.c:350:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:3.0:1789498293.646943:0:3306:0:(events.c:341:request_in_callback()) incoming req@ffff979d7f916300 x1876424575226496 msgsize 224 00000100:00100000:3.0:1789498293.646949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789498293.646951:0:14102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000020:00000020:2.0:1789498293.646956:0:14102:0:(tgt_grant.c:198:tgt_grant_sanity_check()) lustre-OST0000: processing self export: 40828928 0 0 00000100:00000001:3.0:1789498293.646960:0:3306:0:(events.c:377:request_in_callback()) Process leaving 00000020:00000020:2.0:1789498293.646960:0:14102:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff979d7aa10000 dirty 0 pend 0 grant 0 00002000:00000020:2.0:1789498293.646966:0:14102:0:(ofd_obd.c:759:ofd_statfs()) 374 blocks: 372 free, 332 avail; 12297 objects: 11904 free; state 0 00000400:00000200:3.0:1789498293.646969:0:3306:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d6fc6b198 00002000:00000001:2.0:1789498293.646969:0:14102:0:(ofd_obd.c:802:ofd_statfs()) Process leaving 00000400:00000010:3.0:1789498293.646973:0:3306:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d6fc6b198. 00000001:00000001:2.0:1789498293.646977:0:14102:0:(nodemap_handler.c:1181:nodemap_get_from_exp()) Process entered 00000100:00000001:3.0:1789498293.646978:0:3306:0:(events.c:35:request_out_callback()) Process entered 00000001:00000001:2.0:1789498293.646980:0:14102:0:(nodemap_handler.c:1184:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789498293.646985:0:3306:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000001:2.0:1789498293.646985:0:14102:0:(ofd_dev.c:1933:ofd_statfs_hdl()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1789498293.646991:0:14102:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967301, transno 0, xid 1876424575226112 00010000:00000001:2.0:1789498293.646997:0:14102:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:3.0:1789498293.647000:0:3306:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789498293.647007:0:3306:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000200:2.0:1789498293.647007:0:14102:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff979d4716bb80 x1876424575226112/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:324/0 lens 224/368 e 0 to 0 dl 1789498304 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789498293.647036:0:14102:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00000001:3.0:1789498293.647038:0:3306:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498293.647040:0:14102:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647042:0:3306:0:(events.c:69:request_out_callback()) Process leaving 00000100:00001000:2.0:1789498293.647045:0:14102:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d7a9c81e8 time=82 v=5 (1 0 0 0) 00000100:00000001:3.0:1789498293.647048:0:3306:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.647051:0:14102:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1789498293.647054:0:3306:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 14268 usecs (15 jiffies) 00000100:00000040:2.0:1789498293.647056:0:14102:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff979d58b6b900 refcount 21 to 0@lo 00000100:00000001:3.0:1789498293.647058:0:3306:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 0 is 4295121936 00000100:00000001:2.0:1789498293.647060:0:14102:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629300786870528 : -114772922681088 : ffff979d58b6b900) 00000100:00000001:3.0:1789498293.647063:0:3306:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 0, keep current deadline 4295121941 02000000:00000001:2.0:1789498293.647065:0:14102:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000100:00000001:3.0:1789498293.647067:0:3306:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 1 is 4295121936 02000000:00000001:2.0:1789498293.647069:0:14102:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647071:0:3306:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 1, keep current deadline 4295121941 00000100:00000001:2.0:1789498293.647073:0:14102:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:3.0:1789498293.647076:0:3306:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 2 is 4295121936 00000100:00000040:2.0:1789498293.647077:0:14102:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:3.0:1789498293.647080:0:3306:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 2, keep current deadline 4295121941 00000400:00000010:2.0:1789498293.647083:0:14102:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d7b091990. 00000100:00000001:3.0:1789498293.647084:0:3306:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 3 is 4295121936 00000100:00000001:3.0:1789498293.647088:0:3306:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 3, keep current deadline 4295121941 00000100:00000200:2.0:1789498293.647089:0:14102:0:(niobuf.c:94:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1876424575226112, offset 224 00000100:00000001:3.0:1789498293.647092:0:3306:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000400:00000200:2.0:1789498293.647096:0:14102:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:3.0:1789498293.647097:0:3306:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647101:0:3306:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647103:0:3306:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647123:0:13111:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1789498293.647131:0:13111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424575226496 02000000:00000001:3.0:1789498293.647133:0:13111:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789498293.647134:0:13111:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789498293.647136:0:13111:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.647138:0:13111:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789498293.647140:0:13111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424575226496 00000020:00000001:3.0:1789498293.647153:0:13111:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1789498293.647154:0:13111:0:(genops.c:804:class_conn2export()) looking for export cookie 0x4eb017502e6dfe29 00000020:00000001:3.0:1789498293.647156:0:13111:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1789498293.647159:0:13111:0:(lustre_handles.c:148:class_handle2object()) GET export ffff979d7599e800 refcount=5 00000020:00000001:3.0:1789498293.647161:0:13111:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629301271521280 : -114772438030336 : ffff979d7599e800) 00000020:00000001:3.0:1789498293.647163:0:13111:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629301271521280 : -114772438030336 : ffff979d7599e800) 00000100:00000001:3.0:1789498293.647166:0:13111:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789498293.647168:0:13111:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d508f9f00. 00000020:00000010:3.0:1789498293.647172:0:13111:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff979c41ed2a00. 00000020:00000040:3.0:1789498293.647175:0:13111:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff979d50863380) now 8 - evictor 00000100:00000001:3.0:1789498293.647177:0:13111:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000010:3.0:1789498293.647180:0:13111:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff979d7a4b6e00. 00000020:00000010:3.0:1789498293.647183:0:13111:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff979d495a5480. 00000020:00000010:3.0:1789498293.647187:0:13111:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff979d6fc6d898. 00000100:00000040:3.0:1789498293.647192:0:13111:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:3.0:1789498293.647194:0:13111:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1789498293.647195:0:13111:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789498293.647197:0:13111:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.647202:0:13111:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:3.0:1789498293.647204:0:13111:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:3.0:1789498293.647205:0:13111:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647216:0:13111:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.647223:0:13111:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1789498293.647225:0:13111:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1789498293.647228:0:13111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00000040:3.0:1789498293.647231:0:13111:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff979d7599e800 : new rpc_count 1 00000100:00000001:3.0:1789498293.647233:0:13111:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629301438735104 : -114772270816512 : ffff979d7f916300) 00000100:00000040:3.0:1789498293.647237:0:13111:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff979d7f916300 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:324/0 lens 224/0 e 0 to 0 dl 1789498304 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.647260:0:13111:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789498293.647261:0:13111:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d508f9400. 00000100:00000001:3.0:1789498293.647264:0:13111:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789498293.647266:0:13111:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d508f9400. 00000100:00100000:3.0:1789498293.647269:0:13111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff979d7f916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424575226496:12345-0@lo:400:kworker.0 00000100:00000200:3.0:1789498293.647273:0:13111:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424575226496 00000020:00000001:3.0:1789498293.647275:0:13111:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1789498293.647277:0:13111:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789498293.647279:0:13111:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.647281:0:13111:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1789498293.647283:0:13111:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072659624992 : -1049926624 : ffffffffc16b6420) 00000020:00000001:3.0:1789498293.647286:0:13111:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1789498293.647288:0:13111:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789498293.647290:0:13111:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1789498293.647291:0:13111:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1789498293.647293:0:13111:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.647294:0:13111:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1789498293.647298:0:13111:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789498293.647299:0:13111:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789498293.647302:0:13111:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff979c42b82400. 02000000:00000001:3.0:1789498293.647304:0:13111:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647306:0:13111:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.647308:0:13111:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1789498293.647310:0:13111:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424575226496 00010000:00000001:3.0:1789498293.647312:0:13111:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:3.0:1789498293.647316:0:13111:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff979d7f916300 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789498293.647323:0:13111:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1789498293.647325:0:13111:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789498293.647327:0:13111:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d7b0aa5e8 time=99 v=5 (1 0 0 0) 00000100:00000001:3.0:1789498293.647330:0:13111:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1789498293.647332:0:13111:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff979d58b6b900 refcount 22 to 0@lo 00000100:00000001:3.0:1789498293.647337:0:13111:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629300786870528 : -114772922681088 : ffff979d58b6b900) 02000000:00000001:3.0:1789498293.647340:0:13111:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1789498293.647341:0:13111:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.647343:0:13111:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1789498293.647346:0:13111:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1789498293.647348:0:13111:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d6fc6b198. 00000100:00000200:3.0:1789498293.647351:0:13111:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424575226496, offset 224 00000400:00000200:3.0:1789498293.647355:0:13111:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:0.0:1789498293.647433:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789498293.647437:0:3303:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789498293.647438:0:3303:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1789498293.647444:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.647452:0:3303:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1789498293.647453:0:3303:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789498293.647456:0:3303:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1789498293.647457:0:3303:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1789498293.647460:0:3303:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789498293.647463:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff979d7f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f265306-a622-4c44-9fa7-6d84c3fbc1d7:3303:1876424575226240:0@lo:400:kworker.0 00000100:00000001:0.0:1789498293.647466:0:3303:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1789498293.647474:0:3303:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1789498293.647476:0:3303:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789498293.647478:0:3303:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1789498293.647481:0:3303:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff979d7f594a00. 02000000:00000001:0.0:1789498293.647483:0:3303:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1789498293.647487:0:3303:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff979d7fa92420. 00000400:00000010:0.0:1789498293.647490:0:3303:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d73633a18. 00000100:00000200:0.0:1789498293.648737:0:3303:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424575226240, portal 25 00000100:00000001:0.0:1789498293.648744:0:3303:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1789498293.648746:0:3303:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629301438733312 : -114772270818304 : ffff979d7f915c00) 00000100:00000040:0.0:1789498293.648755:0:3303:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.648764:0:3303:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1789498293.648766:0:3303:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1789498293.648779:0:3303:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d73633770. 00000100:00000200:0.0:1789498293.648784:0:3303:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1876424575226240, offset 0 00000400:00000200:0.0:1789498293.648789:0:3303:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1789498293.648961:0:14102:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1789498293.650732:0:13111:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1789498293.650751:0:13111:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9924411280 00000400:00000200:3.0:1789498293.650887:0:13111:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x3bbd [1] + 224 00000400:00000200:3.0:1789498293.650898:0:13111:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1789498293.650902:0:13111:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1789498293.650925:0:13111:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789498293.650935:0:13111:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789498293.650946:0:13111:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.650964:0:13111:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1789498293.650973:0:13111:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d6fc6b198 00000400:00000010:3.0:1789498293.650976:0:13111:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d6fc6b198. 00000100:00000001:3.0:1789498293.650979:0:13111:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789498293.650981:0:13111:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1789498293.650986:0:13111:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789498293.650989:0:13111:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff979d58b6b900 refcount 21 to 0@lo 00010000:00000001:3.0:1789498293.650993:0:13111:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:3.0:1789498293.650996:0:13111:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.650999:0:13111:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1789498293.651005:0:13111:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d7f916300 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498293.651015:0:13111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff979d7f916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876424575226496:12345-0@lo:400:kworker.0 Request processed in 3754us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498293.651036:0:13111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00000040:3.0:1789498293.651048:0:13111:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff979d7599e800 : new rpc_count 0 00000100:00000001:3.0:1789498293.651050:0:13111:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1789498293.651053:0:13111:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1789498293.651060:0:13111:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff979d495a5480. 00000020:00000010:3.0:1789498293.651066:0:13111:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff979d6fc6d898. 00000020:00000010:3.0:1789498293.651070:0:13111:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff979d7a4b6e00. 00000020:00000040:3.0:1789498293.651074:0:13111:0:(genops.c:879:class_export_put()) PUTting export ffff979d7599e800 : new refcount 4 00000100:00000001:3.0:1789498293.651078:0:13111:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.651114:0:3306:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789498293.651117:0:3306:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1789498293.651124:0:3306:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789498293.651126:0:3306:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1789498293.651129:0:3306:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff979d7fa5d3c8. 00000400:00000200:3.0:1789498293.651132:0:3306:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d6fc6b330 00000400:00000010:3.0:1789498293.651134:0:3306:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d6fc6b330. 00000100:00000001:3.0:1789498293.651136:0:3306:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789498293.651141:0:3306:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1789498293.652989:0:3306:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.652998:0:3306:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789498293.653001:0:3306:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.653004:0:3306:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1789498293.653007:0:3306:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789498293.653009:0:3306:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789498293.653011:0:3306:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.653014:0:3306:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789498293.653033:0:3306:0:(import.c:2196:obd_at_measure()) add 5 to ffff979d7aa16460 time=83 v=5 (5 0 0 0) 00000100:00001000:3.0:1789498293.653037:0:3306:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d7aa16418 time=83 v=5 (1 0 0 0) 00000100:00000001:3.0:1789498293.653039:0:3306:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789498293.653041:0:3306:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1789498293.653044:0:3306:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1789498293.653048:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789498293.653054:0:3306:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.653066:0:3306:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1789498293.653069:0:3306:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000001:3.0:1789498293.653071:0:3306:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1789498293.653072:0:3306:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789498293.653076:0:3306:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.653082:0:3306:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789498293.653084:0:3306:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789498293.653086:0:3306:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1789498293.653089:0:3306:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498293.653096:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff979d7f914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876424575226496:0@lo:400:kworker.0 00000100:00000001:3.0:1789498293.653100:0:3306:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.653103:0:3306:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789498293.653106:0:3306:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff979d7f914700 x1876424575226496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.653111:0:3306:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1789498293.653113:0:3306:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1789498293.653117:0:3306:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff979d7a4b7e00. 02000000:00000001:3.0:1789498293.653122:0:3306:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1789498293.653124:0:3306:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789498293.653126:0:3306:0:(genops.c:1222:class_import_put()) import ffff979d7aa16000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000020:00000001:3.0:1789498293.653128:0:3306:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:3.0:1789498293.653130:0:3306:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff979d775ae300. 02000000:00000001:3.0:1789498293.653133:0:3306:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1789498293.653135:0:3306:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1789498293.653137:0:3306:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff979d7f914700. 00000100:00000001:3.0:1789498293.653141:0:3306:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789498293.654325:0:3306:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.654331:0:3306:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.654340:0:3306:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1789498293.654342:0:3306:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.654345:0:3306:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789498293.654348:0:3306:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1789498293.654524:0:3303:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1789498293.654530:0:14102:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 368 into portal 4 MB=0x6aa9924411100 00000400:00000200:0.0:1789498293.654538:0:3303:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6aa9924411180 00000400:00000200:2.0:1789498293.654543:0:14102:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 368/368 into md 0x3bb5 [1] + 224 00000400:00000200:2.0:1789498293.654556:0:14102:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1789498293.654560:0:14102:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1789498293.654679:0:3303:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x2f01 [2] + 0 00000400:00000010:0.0:1789498293.654686:0:3303:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff979d73747528. 00000400:00000200:0.0:1789498293.654692:0:3303:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff979d6011e180 00000100:00000001:2.0:1789498293.654699:0:14102:0:(events.c:80:reply_in_callback()) Process entered 00000400:00000200:0.0:1789498293.654699:0:3303:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1789498293.654704:0:3303:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:0.0:1789498293.654708:0:3303:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d6011e180 00000100:00000200:2.0:1789498293.654710:0:14102:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789498293.654712:0:3303:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at ffff979d6011e180. 00000100:00000001:0.0:1789498293.654721:0:3303:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1789498293.654724:0:3303:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:0.0:1789498293.654727:0:3303:0:(events.c:341:request_in_callback()) incoming req@ffff979d76493050 x1876424575226240 msgsize 224 00000100:00100000:0.0:1789498293.654739:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1789498293.654742:0:3303:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1789498293.654755:0:14102:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.654763:0:3303:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1789498293.654772:0:3303:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d73633770 00000100:00000001:2.0:1789498293.655040:0:14102:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000010:0.0:1789498293.655114:0:3303:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d73633770. 00000100:00000001:0.0:1789498293.655118:0:3303:0:(events.c:35:request_out_callback()) Process entered 00000400:00000200:2.0:1789498293.655124:0:14102:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d7b091990 00000400:00000010:2.0:1789498293.655127:0:14102:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d7b091990. 00000100:00000001:2.0:1789498293.655131:0:14102:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000200:0.0:1789498293.655132:0:3303:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.655134:0:14102:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1789498293.655142:0:14102:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.655146:0:14102:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff979d58b6b900 refcount 20 to 0@lo 00010000:00000001:2.0:1789498293.655150:0:14102:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:2.0:1789498293.655153:0:14102:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.655155:0:14102:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1789498293.655161:0:14102:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d4716bb80 x1876424575226112/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:324/0 lens 224/368 e 0 to 0 dl 1789498304 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498293.655171:0:14102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff979d4716bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876424575226112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8340us (8747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498293.655179:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00000040:2.0:1789498293.655183:0:14102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff979d7aa10000 : new rpc_count 0 00000100:00000001:2.0:1789498293.655185:0:14102:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789498293.655187:0:14102:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1789498293.655193:0:14102:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff979d75755d80. 00000020:00000010:2.0:1789498293.655198:0:14102:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff979d580e3898. 00000100:00000001:0.0:1789498293.655200:0:3303:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000020:00000010:2.0:1789498293.655203:0:14102:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff979d76159600. 00000100:00000040:0.0:1789498293.655207:0:3303:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1789498293.655211:0:14102:0:(genops.c:879:class_export_put()) PUTting export ffff979d7aa10000 : new refcount 4 00000100:00000001:2.0:1789498293.655217:0:14102:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.655220:0:3303:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.655224:0:3303:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1789498293.655231:0:3303:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.655236:0:3303:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS new deadline estimation for cpu 0 is 4295121985 00000100:00000001:0.0:1789498293.655245:0:3303:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295121941 00000100:00000001:0.0:1789498293.655251:0:3303:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS new deadline estimation for cpu 1 is 4295121985 00000100:00000001:0.0:1789498293.655255:0:3303:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295121941 00000100:00000001:0.0:1789498293.655260:0:3303:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS new deadline estimation for cpu 2 is 4295121985 00000100:00000001:2.0:1789498293.655261:0:3305:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789498293.655264:0:3303:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295121941 00000100:00000001:2.0:1789498293.655265:0:3305:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789498293.655271:0:3303:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS new deadline estimation for cpu 3 is 4295121985 00000400:00000001:2.0:1789498293.655273:0:3305:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00000001:0.0:1789498293.655275:0:3303:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.203.148@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295121941 00000400:00000001:2.0:1789498293.655277:0:3305:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1789498293.655280:0:3305:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff979d7f943210. 00000100:00000001:0.0:1789498293.655282:0:3303:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000400:00000200:2.0:1789498293.655284:0:3305:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d7b091660 00000100:00000001:0.0:1789498293.655287:0:3303:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789498293.655288:0:3305:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d7b091660. 00000100:00000001:0.0:1789498293.655292:0:3303:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.655295:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.655298:0:3305:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:0.0:1789498293.655303:0:3303:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000200:2.0:1789498293.655304:0:3305:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.655306:0:3303:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1789498293.655309:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789498293.655310:0:3303:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789498293.655312:0:3303:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789498293.655315:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:0.0:1789498293.655317:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.655319:0:3303:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1789498293.655320:0:3303:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.655322:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789498293.655322:0:3303:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789498293.655324:0:3303:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1789498293.655328:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.655342:0:3303:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1789498293.655344:0:3303:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789498293.655348:0:3303:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1789498293.655351:0:3303:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1789498293.655353:0:3303:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789498293.655357:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff979d7f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876424575226368:0@lo:400:kworker.0 00000100:00000001:0.0:1789498293.655361:0:3303:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1789498293.655364:0:3303:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1789498293.655367:0:3303:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789498293.655370:0:3303:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1789498293.655375:0:3303:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff979d7f594800. 02000000:00000001:0.0:1789498293.655379:0:3303:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1789498293.655387:0:3303:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff979d7fa92a50. 00000100:00000200:2.0:1789498293.655389:0:3305:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789498293.655393:0:3303:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d73633770. 00000100:00000001:2.0:1789498293.655400:0:3305:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000200:0.0:1789498293.655402:0:3303:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424575226368, portal 10 00000100:00000001:2.0:1789498293.655403:0:3305:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.655406:0:3303:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1789498293.655408:0:3305:0:(client.c:1593:after_reply()) Process entered 00000100:00000001:0.0:1789498293.655410:0:3303:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629301438726144 : -114772270825472 : ffff979d7f914000) 02000000:00000001:2.0:1789498293.655412:0:3305:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789498293.655415:0:3305:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789498293.655418:0:3305:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789498293.655422:0:3305:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789498293.655422:0:3303:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00001000:2.0:1789498293.655433:0:3305:0:(import.c:2196:obd_at_measure()) add 5 to ffff979c432184a8 time=82 v=5 (5 0 0 0) 00000100:00000001:0.0:1789498293.655433:0:3303:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1789498293.655437:0:3303:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00001000:2.0:1789498293.655440:0:3305:0:(import.c:2196:obd_at_measure()) add 1 to ffff979c43218418 time=82 v=5 (1 0 0 0) 00000400:00000010:0.0:1789498293.655442:0:3303:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d736332a8. 00000100:00000001:2.0:1789498293.655444:0:3305:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789498293.655447:0:3305:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:0.0:1789498293.655447:0:3303:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424575226368, offset 0 00010000:00000001:2.0:1789498293.655453:0:3305:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000400:00000200:0.0:1789498293.655456:0:3303:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00010000:00080000:2.0:1789498293.655459:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789498293.655468:0:3303:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00010000:00000001:2.0:1789498293.655473:0:3305:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.655478:0:3305:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000400:00000200:0.0:1789498293.655479:0:3303:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9924411200 00000100:00000040:2.0:1789498293.655481:0:3305:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294967301 00000100:00000001:2.0:1789498293.655485:0:3305:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789498293.655488:0:3305:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1789498293.655489:0:3303:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x2765 [64] + 9848 00000100:00000040:2.0:1789498293.655494:0:3305:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.655502:0:3305:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789498293.655505:0:3305:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789498293.655507:0:3305:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000004:00000001:2.0:1789498293.655510:0:3305:0:(osp_precreate.c:128:osp_statfs_interpret()) Process entered 00000004:00000040:2.0:1789498293.655515:0:3305:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0000-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1789498293.655518:0:3305:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0000-osc-MDT0000: blocks=95744 free=95232 avail=84992 avail_mb=332 hwm_mb=3 files=12297 ffree=11904 state=0: rc = 0 00000004:00000020:2.0:1789498293.655525:0:3305:0:(osp_precreate.c:160:osp_statfs_interpret()) lustre-OST0000-osc-MDT0000 (ffff979c4321a000): 95744 blocks, 95232 free, 84992 avail, 4096 bsize, 1 reserved mb low, 3 reserved mb high, 32 reserved ino low, 65 reserved ino high, 12297 files, 11904 free files 0x0 00000004:00000001:2.0:1789498293.655535:0:3305:0:(osp_precreate.c:162:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.655539:0:3305:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498293.655546:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff979d4716b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876424575226112:0@lo:13:osp-pre-0-0.0 00000100:00000001:2.0:1789498293.655551:0:3305:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.655553:0:3305:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789498293.655556:0:3305:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff979d4716b800 x1876424575226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498309 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.655563:0:3305:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1789498293.655565:0:3305:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789498293.655568:0:3305:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff979d80b58800. 02000000:00000001:2.0:1789498293.655571:0:3305:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1789498293.655573:0:3305:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:2.0:1789498293.655575:0:3305:0:(genops.c:1222:class_import_put()) import ffff979c43218000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:2.0:1789498293.655577:0:3305:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:2.0:1789498293.655580:0:3305:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff979d7ef7f800. 02000000:00000001:2.0:1789498293.655584:0:3305:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789498293.655585:0:3305:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1789498293.655587:0:3305:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff979d4716b800. 00000100:00000001:2.0:1789498293.655590:0:3305:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1789498293.655591:0:3305:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.655592:0:3305:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.655597:0:3305:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789498293.655598:0:3305:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.655673:0:3305:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789498293.655675:0:3305:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.655871:0:13103:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1789498293.655874:0:13103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424575226240 02000000:00000001:3.0:1789498293.655876:0:13103:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789498293.655878:0:13103:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789498293.655880:0:13103:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789498293.655884:0:13103:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789498293.655887:0:13103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424575226240 00000020:00000001:3.0:1789498293.655889:0:13103:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1789498293.655891:0:13103:0:(genops.c:804:class_conn2export()) looking for export cookie 0x4eb017502e6dfcd9 00000020:00000001:3.0:1789498293.655893:0:13103:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1789498293.655896:0:13103:0:(lustre_handles.c:148:class_handle2object()) GET export ffff979d6ad0b000 refcount=16 00000020:00000001:3.0:1789498293.655899:0:13103:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629301090562048 : -114772618989568 : ffff979d6ad0b000) 00000020:00000001:3.0:1789498293.655901:0:13103:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629301090562048 : -114772618989568 : ffff979d6ad0b000) 00000100:00000001:3.0:1789498293.655948:0:13103:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789498293.655953:0:13103:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d508f9400. 00000100:00000001:3.0:1789498293.655956:0:13103:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789498293.655959:0:13103:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d508f9400. 00000020:00000010:3.0:1789498293.655965:0:13103:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff979d7a4b7e00. 00000020:00000010:3.0:1789498293.655969:0:13103:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff979d495a5480. 00000020:00000010:3.0:1789498293.655973:0:13103:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff979d6fc6d898. 00000100:00000040:3.0:1789498293.655980:0:13103:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:3.0:1789498293.655983:0:13103:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1789498293.655985:0:13103:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789498293.655986:0:13103:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.655993:0:13103:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.656001:0:13103:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789498293.656008:0:13103:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1789498293.656010:0:13103:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1789498293.656014:0:13103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00000040:3.0:1789498293.656017:0:13103:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff979d6ad0b000 : new rpc_count 1 00000100:00000001:3.0:1789498293.656019:0:13103:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629301283008592 : -114772426543024 : ffff979d76493050) 00000100:00000040:3.0:1789498293.656033:0:13103:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff979d76493050 x1876424575226240/t0(0) o400->5f265306-a622-4c44-9fa7-6d84c3fbc1d7@0@lo:324/0 lens 224/0 e 0 to 0 dl 1789498304 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789498293.656042:0:13103:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789498293.656050:0:13103:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d508f9400. 00000100:00000001:3.0:1789498293.656052:0:13103:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789498293.656054:0:13103:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d508f9400. 00000100:00100000:3.0:1789498293.656058:0:13103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff979d76493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f265306-a622-4c44-9fa7-6d84c3fbc1d7+16:3303:x1876424575226240:12345-0@lo:400:kworker.0 00000100:00000200:3.0:1789498293.656062:0:13103:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424575226240 00000020:00000001:3.0:1789498293.656065:0:13103:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1789498293.656069:0:13103:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789498293.656071:0:13103:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.656073:0:13103:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1789498293.656075:0:13103:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667564224 : -1041987392 : ffffffffc1e488c0) 00000020:00000001:3.0:1789498293.656079:0:13103:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1789498293.656080:0:13103:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789498293.656082:0:13103:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1789498293.656084:0:13103:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1789498293.656086:0:13103:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.656088:0:13103:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1789498293.656091:0:13103:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789498293.656093:0:13103:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789498293.656098:0:13103:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff979c42b81800. 02000000:00000001:3.0:1789498293.656100:0:13103:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.656103:0:13103:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789498293.656105:0:13103:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1789498293.656108:0:13103:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424575226240 00010000:00000001:3.0:1789498293.656110:0:13103:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:3.0:1789498293.656114:0:13103:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff979d76493050 x1876424575226240/t0(0) o400->5f265306-a622-4c44-9fa7-6d84c3fbc1d7@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789498293.656122:0:13103:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1789498293.656124:0:13103:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789498293.656126:0:13103:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d759085e8 time=105 v=5 (1 0 0 0) 00000100:00000001:3.0:1789498293.656130:0:13103:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1789498293.656132:0:13103:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff979d58b6b900 refcount 21 to 0@lo 00000100:00000001:3.0:1789498293.656135:0:13103:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629300786870528 : -114772922681088 : ffff979d58b6b900) 02000000:00000001:3.0:1789498293.656137:0:13103:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1789498293.656139:0:13103:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789498293.656158:0:13103:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1789498293.656161:0:13103:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1789498293.656164:0:13103:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d6fc6b330. 00000400:00000200:0.0:1789498293.656330:0:3303:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1789498293.656335:0:3303:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00080000:1.0:1789498293.662262:0:13106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1789498293.662273:0:13106:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff979d50863380) now 8 - evictor 00000100:00080000:1.0:1789498293.662278:0:13106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000040:1.0:1789498293.662281:0:13106:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff979d7c0119c0) now 6 - evictor 00000100:00000001:1.0:1789498293.662288:0:3304:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789498293.662290:0:3304:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789498293.662609:0:13103:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1876424575226240, offset 224 00000400:00000200:2.0:1789498293.662667:0:13103:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1789498293.662681:0:13103:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1789498293.662692:0:13103:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6aa9924411180 00000400:00000200:2.0:1789498293.662700:0:13103:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0x3bcd [1] + 224 00000400:00000200:2.0:1789498293.662709:0:13103:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1789498293.662713:0:13103:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1789498293.662727:0:13103:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789498293.662737:0:13103:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789498293.662748:0:13103:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.662756:0:13103:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1789498293.662764:0:13103:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d6fc6b330 00000400:00000010:2.0:1789498293.662767:0:13103:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d6fc6b330. 00000100:00000001:2.0:1789498293.662771:0:13103:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1789498293.662783:0:13103:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1789498293.662789:0:13103:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.662792:0:13103:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff979d58b6b900 refcount 20 to 0@lo 00010000:00000001:2.0:1789498293.662795:0:13103:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:2.0:1789498293.662798:0:13103:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.662801:0:13103:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1789498293.662806:0:13103:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d76493050 x1876424575226240/t0(0) o400->5f265306-a622-4c44-9fa7-6d84c3fbc1d7@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498293.662815:0:13103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff979d76493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f265306-a622-4c44-9fa7-6d84c3fbc1d7+16:3303:x1876424575226240:12345-0@lo:400:kworker.0 Request processed in 6772us (8086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498293.662825:0:13103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00000040:2.0:1789498293.662829:0:13103:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff979d6ad0b000 : new rpc_count 0 00000100:00000001:2.0:1789498293.662831:0:13103:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789498293.662833:0:13103:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1789498293.662839:0:13103:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff979d495a5480. 00000020:00000010:2.0:1789498293.662842:0:13103:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff979d6fc6d898. 00000020:00000010:2.0:1789498293.662846:0:13103:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff979d7a4b7e00. 00000020:00000040:2.0:1789498293.662851:0:13103:0:(genops.c:879:class_export_put()) PUTting export ffff979d6ad0b000 : new refcount 15 02000000:00000001:2.0:1789498293.662856:0:13103:0:(sec.c:2664:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:2.0:1789498293.662859:0:13103:0:(sec_null.c:327:null_free_rs()) kvfree 'rs': 520 at ffff979c42b81800. 02000000:00000001:2.0:1789498293.662861:0:13103:0:(sec.c:2677:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:2.0:1789498293.662864:0:13103:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:2.0:1789498293.662870:0:13103:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:2.0:1789498293.662875:0:13103:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff979d7f943210. 00000400:00000010:2.0:1789498293.662886:0:13103:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff979c422cdf00. 00000100:00000001:0.0:1789498293.667727:0:3303:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:0.0:1789498293.667735:0:3303:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:0.0:1789498293.667742:0:3303:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff979d6f986300. 00000100:00000040:0.0:1789498293.667754:0:3303:0:(events.c:341:request_in_callback()) incoming req@ffff979d6f986300 x1876424575226368 msgsize 224 00000100:00100000:0.0:1789498293.667761:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:0.0:1789498293.667782:0:3303:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1789498293.667796:0:3303:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d736332a8 00000400:00000010:0.0:1789498293.667800:0:3303:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d736332a8. 00000100:00000001:0.0:1789498293.667803:0:3303:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:0.0:1789498293.667810:0:3303:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.667821:0:3303:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1789498293.667824:0:3303:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.667832:0:3303:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.667834:0:3303:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1789498293.667842:0:3303:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789498293.667848:0:3303:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8105 usecs (9 jiffies) 00000100:00000001:0.0:1789498293.667852:0:3303:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295121950 00000100:00000001:0.0:1789498293.667857:0:3303:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295121985 00000100:00000001:0.0:1789498293.667860:0:3303:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295121950 00000100:00000001:0.0:1789498293.667861:0:3303:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295121985 00000100:00000001:0.0:1789498293.667863:0:3303:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295121950 00000100:00000001:0.0:1789498293.667866:0:3303:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295121985 00000100:00000001:0.0:1789498293.667868:0:3303:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295121950 00000100:00000001:0.0:1789498293.667870:0:3303:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295121985 00000100:00000001:0.0:1789498293.667872:0:3303:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789498293.667875:0:3303:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1789498293.667884:0:3303:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1789498293.667886:0:3303:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1789498293.667888:0:3303:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff979d7fa92420. 00000400:00000200:0.0:1789498293.667892:0:3303:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d73633a18 00000400:00000010:0.0:1789498293.667894:0:3303:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d73633a18. 00000100:00000001:0.0:1789498293.667896:0:3303:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1789498293.667935:0:3303:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1789498293.667944:0:3303:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.667951:0:3303:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1789498293.667953:0:3303:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.667955:0:3303:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1789498293.667958:0:3303:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1789498293.667960:0:3303:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789498293.667962:0:3303:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789498293.667966:0:3303:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1789498293.667972:0:3303:0:(import.c:2196:obd_at_measure()) add 5 to ffff979d6ad11c60 time=105 v=5 (5 0 0 0) 00000100:00001000:0.0:1789498293.667976:0:3303:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d6ad11c18 time=105 v=5 (1 0 0 0) 00000100:00000001:0.0:1789498293.667978:0:3303:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1789498293.667980:0:3303:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789498293.667983:0:3303:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1789498293.667985:0:3303:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.667988:0:3303:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789498293.667992:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.667998:0:3303:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789498293.668000:0:3303:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1789498293.668002:0:3303:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789498293.668006:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498293.668013:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff979d7f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f265306-a622-4c44-9fa7-6d84c3fbc1d7:3303:1876424575226240:0@lo:400:kworker.0 00000100:00000001:0.0:1789498293.668018:0:3303:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.668029:0:3303:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1789498293.668032:0:3303:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff979d7f915c00 x1876424575226240/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789498293.668037:0:3303:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1789498293.668039:0:3303:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1789498293.668048:0:3303:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff979d7f594a00. 02000000:00000001:0.0:1789498293.668052:0:3303:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1789498293.668054:0:3303:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:0.0:1789498293.668056:0:3303:0:(genops.c:1222:class_import_put()) import ffff979d6ad11800 refcount=3 obd=MGC192.168.203.148@tcp 00000020:00000001:0.0:1789498293.668058:0:3303:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:0.0:1789498293.668060:0:3303:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff979d775aeb00. 02000000:00000001:0.0:1789498293.668063:0:3303:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1789498293.668065:0:3303:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789498293.668067:0:3303:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff979d7f915c00. 00000100:00000001:0.0:1789498293.668069:0:3303:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1789498293.668070:0:3303:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789498293.668073:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.668075:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789498293.668077:0:3303:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789498293.668102:0:3303:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789498293.668104:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.668484:0:14124:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1789498293.668487:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424575226368 02000000:00000001:2.0:1789498293.668490:0:14124:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1789498293.668491:0:14124:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789498293.668493:0:14124:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789498293.668506:0:14124:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789498293.668510:0:14124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424575226368 00000020:00000001:2.0:1789498293.668512:0:14124:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1789498293.668514:0:14124:0:(genops.c:804:class_conn2export()) looking for export cookie 0x4eb017502e6dfda4 00000020:00000001:2.0:1789498293.668517:0:14124:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1789498293.668520:0:14124:0:(lustre_handles.c:148:class_handle2object()) GET export ffff979d47a05000 refcount=5 00000020:00000001:2.0:1789498293.668523:0:14124:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629300500189184 : -114773209362432 : ffff979d47a05000) 00000020:00000001:2.0:1789498293.668525:0:14124:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629300500189184 : -114773209362432 : ffff979d47a05000) 00000100:00000001:2.0:1789498293.668529:0:14124:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1789498293.668533:0:14124:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d7a9a1780. 00000100:00000001:2.0:1789498293.668535:0:14124:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1789498293.668538:0:14124:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d7a9a1780. 00000020:00000010:2.0:1789498293.668545:0:14124:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff979d76159200. 00000020:00000010:2.0:1789498293.668550:0:14124:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff979d75755d80. 00000020:00000010:2.0:1789498293.668555:0:14124:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff979d580e3898. 00000100:00000040:2.0:1789498293.668564:0:14124:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:2.0:1789498293.668566:0:14124:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1789498293.668567:0:14124:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1789498293.668570:0:14124:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.668576:0:14124:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:2.0:1789498293.668579:0:14124:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:2.0:1789498293.668580:0:14124:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.668592:0:14124:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.668602:0:14124:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789498293.668604:0:14124:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1789498293.668609:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00000040:2.0:1789498293.668612:0:14124:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff979d47a05000 : new rpc_count 1 00000100:00000001:2.0:1789498293.668614:0:14124:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629301170758400 : -114772538793216 : ffff979d6f986300) 00000100:00000040:2.0:1789498293.668618:0:14124:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff979d6f986300 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:324/0 lens 224/0 e 0 to 0 dl 1789498304 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.668634:0:14124:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1789498293.668637:0:14124:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff979d7a9a1780. 00000100:00000001:2.0:1789498293.668639:0:14124:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1789498293.668641:0:14124:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff979d7a9a1780. 00000100:00100000:2.0:1789498293.668644:0:14124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff979d6f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876424575226368:12345-0@lo:400:kworker.0 00000100:00000200:2.0:1789498293.668647:0:14124:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424575226368 00000020:00000001:2.0:1789498293.668650:0:14124:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1789498293.668653:0:14124:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1789498293.668655:0:14124:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.668657:0:14124:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1789498293.668660:0:14124:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072659624992 : -1049926624 : ffffffffc16b6420) 00000020:00000001:2.0:1789498293.668663:0:14124:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1789498293.668665:0:14124:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789498293.668667:0:14124:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1789498293.668669:0:14124:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1789498293.668671:0:14124:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.668673:0:14124:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:2.0:1789498293.668677:0:14124:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1789498293.668680:0:14124:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1789498293.668684:0:14124:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff979d80b58800. 02000000:00000001:2.0:1789498293.668686:0:14124:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.668688:0:14124:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.668690:0:14124:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1789498293.668693:0:14124:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424575226368 00010000:00000001:2.0:1789498293.668695:0:14124:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:2.0:1789498293.668699:0:14124:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff979d6f986300 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789498293.668706:0:14124:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1789498293.668708:0:14124:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1789498293.668711:0:14124:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d7b0aa5e8 time=99 v=5 (1 0 0 0) 00000100:00000001:2.0:1789498293.668714:0:14124:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1789498293.668716:0:14124:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff979d58b6b900 refcount 21 to 0@lo 00000100:00000001:2.0:1789498293.668723:0:14124:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629300786870528 : -114772922681088 : ffff979d58b6b900) 02000000:00000001:2.0:1789498293.668726:0:14124:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1789498293.668728:0:14124:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.668731:0:14124:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789498293.668733:0:14124:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1789498293.668738:0:14124:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff979d7b091660. 00000100:00000200:2.0:1789498293.668743:0:14124:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424575226368, offset 224 00000400:00000200:2.0:1789498293.668748:0:14124:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1789498293.668759:0:14124:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1789498293.668767:0:14124:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9924411200 00000400:00000200:2.0:1789498293.668787:0:14124:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x3bd5 [1] + 224 00000400:00000200:2.0:1789498293.668795:0:14124:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1789498293.668799:0:14124:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1789498293.668805:0:14124:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789498293.668809:0:14124:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789498293.668816:0:14124:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.668829:0:14124:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1789498293.668835:0:14124:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d7b091660 00000400:00000010:2.0:1789498293.668837:0:14124:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d7b091660. 00000100:00000001:2.0:1789498293.668840:0:14124:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1789498293.668841:0:14124:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1789498293.668845:0:14124:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.668847:0:14124:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff979d58b6b900 refcount 20 to 0@lo 00010000:00000001:2.0:1789498293.668849:0:14124:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:2.0:1789498293.668851:0:14124:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789498293.668854:0:14124:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1789498293.668857:0:14124:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d6f986300 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:324/0 lens 224/224 e 0 to 0 dl 1789498304 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498293.668864:0:14124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff979d6f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876424575226368:12345-0@lo:400:kworker.0 Request processed in 230us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498293.668871:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00000040:2.0:1789498293.668879:0:14124:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff979d47a05000 : new rpc_count 0 00000100:00000001:2.0:1789498293.668881:0:14124:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789498293.668883:0:14124:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1789498293.668887:0:14124:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff979d75755d80. 00000020:00000010:2.0:1789498293.668891:0:14124:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff979d580e3898. 00000020:00000010:2.0:1789498293.668894:0:14124:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff979d76159200. 00000020:00000040:2.0:1789498293.668899:0:14124:0:(genops.c:879:class_export_put()) PUTting export ffff979d47a05000 : new refcount 4 00000100:00000001:2.0:1789498293.668902:0:14124:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.668936:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789498293.668938:0:3303:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1789498293.668941:0:3303:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1789498293.668943:0:3303:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1789498293.668945:0:3303:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff979d7fa92a50. 00000400:00000200:2.0:1789498293.668948:0:3303:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff979d73633770 00000400:00000010:2.0:1789498293.668950:0:3303:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff979d73633770. 00000100:00000001:2.0:1789498293.668952:0:3303:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789498293.668956:0:3303:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789498293.668964:0:3303:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.668970:0:3303:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789498293.668972:0:3303:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.668974:0:3303:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1789498293.668975:0:3303:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789498293.668976:0:3303:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789498293.668978:0:3303:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789498293.668980:0:3303:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1789498293.668985:0:3303:0:(import.c:2196:obd_at_measure()) add 5 to ffff979d47a04c60 time=99 v=5 (5 0 0 0) 00000100:00001000:2.0:1789498293.668988:0:3303:0:(import.c:2196:obd_at_measure()) add 1 to ffff979d47a04c18 time=99 v=5 (1 0 0 0) 00000100:00000001:2.0:1789498293.668990:0:3303:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789498293.668991:0:3303:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789498293.668993:0:3303:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1789498293.668997:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789498293.669003:0:3303:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.669011:0:3303:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1789498293.669013:0:3303:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:2.0:1789498293.669015:0:3303:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789498293.669016:0:3303:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.669020:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.669036:0:3303:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789498293.669038:0:3303:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789498293.669040:0:3303:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1789498293.669043:0:3303:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498293.669049:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff979d7f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876424575226368:0@lo:400:kworker.0 00000100:00000001:2.0:1789498293.669053:0:3303:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.669055:0:3303:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789498293.669057:0:3303:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff979d7f914000 x1876424575226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498309 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789498293.669063:0:3303:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1789498293.669064:0:3303:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789498293.669067:0:3303:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff979d7f594800. 02000000:00000001:2.0:1789498293.669069:0:3303:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1789498293.669071:0:3303:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:2.0:1789498293.669072:0:3303:0:(genops.c:1222:class_import_put()) import ffff979d47a04800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:2.0:1789498293.669074:0:3303:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:2.0:1789498293.669076:0:3303:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff979d775aef00. 02000000:00000001:2.0:1789498293.669078:0:3303:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789498293.669079:0:3303:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1789498293.669081:0:3303:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff979d7f914000. 00000100:00000001:2.0:1789498293.669083:0:3303:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1789498293.669084:0:3303:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.669086:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789498293.669091:0:3303:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789498293.669093:0:3303:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789498293.669095:0:3303:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789498293.669097:0:3303:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789498293.711033:0:12525:0:(connection.c:75:cpu_latency_work()) work item of ffff979d4338ca20 (cpu 2) has reached its deadline 4295121985, at 4295121986 00000100:00000010:2.0:1789498293.711045:0:12525:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff979d50897f00. 00000100:00000040:3.0:1789498293.711585:0:53:0:(connection.c:75:cpu_latency_work()) work item of ffff979d4338cb30 (cpu 3) has reached its deadline 4295121985, at 4295121986 00000100:00000010:3.0:1789498293.711592:0:53:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff979d508978a0. 00000100:00000040:1.0:1789498293.711956:0:3001:0:(connection.c:75:cpu_latency_work()) work item of ffff979d4338c910 (cpu 1) has reached its deadline 4295121985, at 4295121986 00000100:00000010:1.0:1789498293.711963:0:3001:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff979d508972a0. 00000100:00000040:0.0:1789498293.712013:0:10229:0:(connection.c:75:cpu_latency_work()) work item of ffff979d4338c800 (cpu 0) has reached its deadline 4295121985, at 4295121986 00000100:00000010:0.0:1789498293.712018:0:10229:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff979d50897420. Debug log: 1037 lines, 1037 kept, 0 dropped, 0 bad.