00000004:00000001:3.0F:1789499363.599067:0:10052:0:(osp_precreate.c:196:osp_statfs_update()) Process entered 00000004:00000020:3.0:1789499363.599084:0:10052:0:(osp_precreate.c:198:osp_statfs_update()) going to update statfs 00000100:00000010:3.0:1789499363.599090:0:10052:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3fcdb7480. 00000020:00000040:3.0:1789499363.599098:0:10052:0:(genops.c:1209:class_import_get()) import ffff9ab3fcf04800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000001:3.0:1789499363.599102:0:10052:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1789499363.599104:0:10052:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1789499363.599109:0:10052:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499363.599116:0:10052:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c3034800. 00000100:00000001:3.0:1789499363.599123:0:10052:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.599129:0:10052:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1789499363.599133:0:10052:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499363.599144:0:10052:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000084b67819] to pc [ptlrpcd_00_03+3] req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000001:3.0:1789499363.599186:0:10052:0:(osp_precreate.c:256:osp_statfs_update()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0F:1789499363.599681:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789499363.599691:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499363.599693:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1789499363.599699:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499363.599709:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1789499363.599711:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499363.599714:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1789499363.599717:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1789499363.599719:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1789499363.599723:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab3fcdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122723584:0@lo:13:osp-pre-1-1.0 00000100:00000001:1.0:1789499363.599726:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1789499363.599731:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1789499363.599732:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499363.599734:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1789499363.599738:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff9ab2c4dcb400. 02000000:00000001:1.0:1789499363.599740:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1789499363.599746:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3fcfbbb58. 00000400:00000010:1.0:1789499363.599752:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4000. 00000100:00000200:1.0:1789499363.599757:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1876424122723584, portal 4 00000100:00000001:1.0:1789499363.599760:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1789499363.599761:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632696564905088 : -111377144646528 : ffff9ab3fcdb7480) 00000100:00000040:1.0:1789499363.599768:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499363.599776:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1789499363.599778:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1789499363.599781:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4b28. 00000100:00000200:1.0:1789499363.599783:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1876424122723584, offset 0 00000400:00000200:1.0:1789499363.599788:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1789499363.599799:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1789499363.599808:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 7 MB=0x6aa9909486d00 00000400:00000200:1.0:1789499363.599813:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 7 from 12345-0@lo of length 224/224 into md 0x10dd [8] + 9184 00000400:00000200:1.0:1789499363.599821:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499363.599825:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1789499363.599835:0:3616:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1789499363.599837:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost_create 00000100:00000010:1.0:1789499363.599841:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c9880. 00000100:00000040:1.0:1789499363.599844:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c27c9880 x1876424122723584 msgsize 224 00000100:00100000:1.0:1789499363.599848:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1789499363.599862:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1789499363.599872:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4b28 00000400:00000010:1.0:1789499363.599874:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4b28. 00000100:00000001:1.0:1789499363.599877:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1789499363.599881:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499363.599889:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1789499363.599892:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499363.599907:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499363.599908:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1789499363.599914:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499363.599918:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 10166 usecs (11 jiffies) 00000100:00000001:1.0:1789499363.599921:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296589836 00000100:00000010:1.0:1789499363.599925:0:3616:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d4240. 00000100:00000001:1.0:1789499363.599931:0:3616:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request now active for cpu 0 00000100:00000001:1.0:1789499363.599936:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296589836 00000100:00000010:1.0:1789499363.599939:0:3616:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d4cc0. 00000100:00000001:1.0:1789499363.599942:0:3616:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request now active for cpu 1 00000100:00000001:1.0:1789499363.599944:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296589836 00000100:00000010:1.0:1789499363.599947:0:3616:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d40c0. 00000100:00000001:1.0:1789499363.599950:0:3616:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request now active for cpu 2 00000100:00000001:1.0:1789499363.599956:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296589836 00000100:00000010:1.0:1789499363.599959:0:3616:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d42a0. 00000100:00000001:1.0:1789499363.599962:0:3616:0:(niobuf.c:678:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request now active for cpu 3 00000100:00000001:1.0:1789499363.599967:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1789499363.599974:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499363.599977:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499363.599979:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499363.599986:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1789499363.599988:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1789499363.599990:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789499363.599991:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499363.599992:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499363.599995:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0F:1789499363.600050:0:3615:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499363.600058:0:3615:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.600118:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1789499363.600121:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122723584 02000000:00000001:3.0:1789499363.600123:0:8396:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789499363.600125:0:8396:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499363.600128:0:8396:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499363.600131:0:8396:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499363.600135:0:8396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122723584 00000020:00000001:3.0:1789499363.600138:0:8396:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1789499363.600139:0:8396:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffb765 00000020:00000001:3.0:1789499363.600142:0:8396:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1789499363.600145:0:8396:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c2575000 refcount=5 00000020:00000001:3.0:1789499363.600148:0:8396:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691288199168 : -111382421352448 : ffff9ab2c2575000) 00000020:00000001:3.0:1789499363.600150:0:8396:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691288199168 : -111382421352448 : ffff9ab2c2575000) 00000100:00000001:3.0:1789499363.600154:0:8396:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789499363.600158:0:8396:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816f00. 00000020:00000040:3.0:1789499363.600165:0:8396:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000100:00000001:3.0:1789499363.600180:0:8396:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000010:3.0:1789499363.600185:0:8396:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5381c00. 00000020:00000010:3.0:1789499363.600189:0:8396:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fe700. 00000020:00000010:3.0:1789499363.600194:0:8396:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9e10. 00000100:00000040:3.0:1789499363.600202:0:8396:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000001:3.0:1789499363.600210:0:8396:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1789499363.600211:0:8396:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789499363.600214:0:8396:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.600221:0:8396:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1789499363.600303:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1789499363.600308:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000100:00000001:3.0:1789499363.601829:0:8396:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499363.601849:0:8396:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1789499363.601851:0:8396:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1789499363.601858:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00000040:3.0:1789499363.601862:0:8396:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c2575000 : new rpc_count 1 00000100:00000001:3.0:1789499363.601865:0:8396:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691290642560 : -111382418909056 : ffff9ab2c27c9880) 00000100:00000040:3.0:1789499363.601872:0:8396:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c27c9880 x1876424122723584/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:639/0 lens 224/0 e 0 to 0 dl 1789499374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499363.601882:0:8396:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789499363.601887:0:8396:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c48169c0. 00000100:00000001:3.0:1789499363.601891:0:8396:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789499363.601893:0:8396:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c48169c0. 00000100:00100000:3.0:1789499363.601911:0:8396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c27c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122723584:12345-0@lo:13:osp-pre-1-1.0 00000100:00000200:3.0:1789499363.601918:0:8396:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122723584 00000020:00000001:3.0:1789499363.601922:0:8396:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1789499363.601925:0:8396:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789499363.601927:0:8396:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499363.601930:0:8396:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1789499363.601932:0:8396:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667320752 : -1042230864 : ffffffffc1e0d1b0) 00000020:00000001:3.0:1789499363.601935:0:8396:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1789499363.601938:0:8396:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499363.601940:0:8396:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1789499363.601942:0:8396:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1789499363.601945:0:8396:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.601949:0:8396:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789499363.601951:0:8396:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789499363.601956:0:8396:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 664 at ffff9ab2c5357c00. 02000000:00000001:3.0:1789499363.601959:0:8396:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.601961:0:8396:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00002000:00000001:3.0:1789499363.601971:0:8396:0:(ofd_dev.c:1915:ofd_statfs_hdl()) Process entered 00002000:00000001:3.0:1789499363.601976:0:8396:0:(ofd_obd.c:710:ofd_statfs()) Process entered 00000020:00000001:3.0:1789499363.601979:0:8396:0:(tgt_grant.c:274:tgt_statfs_internal()) Process entered 00000020:00000001:3.0:1789499363.601989:0:8396:0:(tgt_grant.c:350:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0) 00002000:00000024:3.0:1789499363.601992:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 228928 pending 0 free 3923427328 avail 3691905024 00000020:00000020:3.0:1789499363.601996:0:8396:0:(tgt_grant.c:198:tgt_grant_sanity_check()) lustre-OST0001: processing self export: 228928 0 0 00000020:00000020:3.0:1789499363.601999:0:8396:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ab3c57ae000 dirty 0 pend 0 grant 0 00000020:00000020:3.0:1789499363.602002:0:8396:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ab2c2575000 dirty 0 pend 0 grant 0 00002000:00000020:3.0:1789499363.602005:0:8396:0:(ofd_obd.c:759:ofd_statfs()) 958279 blocks: 957868 free, 901289 avail; 262144 objects: 261772 free; state 0 00002000:00000001:3.0:1789499363.602008:0:8396:0:(ofd_obd.c:802:ofd_statfs()) Process leaving 00000001:00000001:3.0:1789499363.602012:0:8396:0:(nodemap_handler.c:1181:nodemap_get_from_exp()) Process entered 00000001:00000001:3.0:1789499363.602013:0:8396:0:(nodemap_handler.c:1184:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00002000:00000001:3.0:1789499363.602015:0:8396:0:(ofd_dev.c:1933:ofd_statfs_hdl()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1789499363.602018:0:8396:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967298, transno 0, xid 1876424122723584 00010000:00000001:3.0:1789499363.602020:0:8396:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:3.0:1789499363.602025:0:8396:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c27c9880 x1876424122723584/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:639/0 lens 224/368 e 0 to 0 dl 1789499374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789499363.602034:0:8396:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1789499363.602036:0:8396:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499363.602040:0:8396:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcec5de8 time=10 v=5 (1 1 1 1) 00000100:00000001:3.0:1789499363.602044:0:8396:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1789499363.602046:0:8396:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:3.0:1789499363.602049:0:8396:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 02000000:00000001:3.0:1789499363.602051:0:8396:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1789499363.602053:0:8396:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499363.602055:0:8396:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1789499363.602058:0:8396:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1789499363.602063:0:8396:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf880. 00000100:00000200:3.0:1789499363.602067:0:8396:0:(niobuf.c:94:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1876424122723584, offset 224 00000400:00000200:3.0:1789499363.602074:0:8396:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1789499363.602084:0:8396:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1789499363.602093:0:8396:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 368 into portal 4 MB=0x6aa9909486d00 00000400:00000200:3.0:1789499363.602099:0:8396:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 368/368 into md 0x35ec5 [1] + 224 00000400:00000200:3.0:1789499363.602107:0:8396:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1789499363.602117:0:8396:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1789499363.602123:0:8396:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789499363.602128:0:8396:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789499363.602138:0:8396:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499363.602197:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499363.602200:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1789499363.602217:0:8396:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1789499363.602225:0:8396:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf880 00000400:00000010:3.0:1789499363.602227:0:8396:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf880. 00000100:00000001:3.0:1789499363.602230:0:8396:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789499363.602232:0:8396:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1789499363.602236:0:8396:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499363.602239:0:8396:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00010000:00000001:3.0:1789499363.602242:0:8396:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:3.0:1789499363.602243:0:8396:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499363.602246:0:8396:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1789499363.602249:0:8396:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c9880 x1876424122723584/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:639/0 lens 224/368 e 0 to 0 dl 1789499374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499363.602258:0:8396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c27c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122723584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 375us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789499363.602265:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00000040:3.0:1789499363.602268:0:8396:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c2575000 : new rpc_count 0 00000100:00000001:3.0:1789499363.602271:0:8396:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1789499363.602272:0:8396:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1789499363.602277:0:8396:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fe700. 00000020:00000010:3.0:1789499363.602281:0:8396:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9e10. 00000020:00000010:3.0:1789499363.602285:0:8396:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5381c00. 00000020:00000040:3.0:1789499363.602289:0:8396:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c2575000 : new refcount 4 00000100:00000001:3.0:1789499363.602292:0:8396:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000400:00000001:2.0:1789499363.602317:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1789499363.602319:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1789499363.602322:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3fcfbbb58. 00000400:00000200:2.0:1789499363.602326:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4000 00000400:00000010:2.0:1789499363.602328:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4000. 00000100:00000001:2.0:1789499363.602331:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789499363.602335:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789499363.602342:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499363.602348:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499363.602349:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499363.602352:0:3616:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1789499363.602355:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789499363.602356:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789499363.602358:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499363.602361:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1789499363.602367:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3fcf04cf0 time=142 v=5 (5 5 5 5) 00000100:00001000:2.0:1789499363.602370:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcf04c18 time=142 v=5 (1 1 1 1) 00000100:00000001:2.0:1789499363.602373:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499363.602374:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789499363.602377:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1789499363.602379:0:3616:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499363.602383:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1789499363.602384:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294967298 00000100:00000001:2.0:1789499363.602386:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789499363.602388:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499363.602392:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499363.602398:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499363.602408:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789499363.602410:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000004:00000001:2.0:1789499363.602412:0:3616:0:(osp_precreate.c:128:osp_statfs_interpret()) Process entered 00000004:00000040:2.0:1789499363.602415:0:3616:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1789499363.602419:0:3616:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957868 avail=901289 avail_mb=3520 hwm_mb=7 files=262144 ffree=261772 state=0: rc = 0 00000004:00000020:2.0:1789499363.602426:0:3616:0:(osp_precreate.c:160:osp_statfs_interpret()) lustre-OST0001-osc-MDT0001 (ffff9ab3ffa17800): 958279 blocks, 957868 free, 901289 avail, 4096 bsize, 3 reserved mb low, 7 reserved mb high, 32 reserved ino low, 65 reserved ino high, 262144 files, 261772 free files 0x0 00000004:00000001:2.0:1789499363.602430:0:3616:0:(osp_precreate.c:162:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499363.602451:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789499363.602459:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab3fcdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122723584:0@lo:13:osp-pre-1-1.0 00000100:00000001:2.0:1789499363.602463:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499363.602466:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789499363.602468:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab3fcdb7480 x1876424122723584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789499379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499363.602474:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1789499363.602477:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789499363.602479:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff9ab2c4dcb400. 02000000:00000001:2.0:1789499363.602483:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1789499363.602484:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:2.0:1789499363.602486:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab3fcf04800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:00000001:2.0:1789499363.602488:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:2.0:1789499363.602490:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c3034800. 02000000:00000001:2.0:1789499363.602495:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789499363.602497:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1789499363.602498:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab3fcdb7480. 00000100:00000001:2.0:1789499363.602501:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1789499363.602503:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499363.602505:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499363.602510:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789499363.602512:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499363.602514:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499363.602516:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0F:1789499363.611697:0:23949:0:(connection.c:75:cpu_latency_work()) work item of ffff9ab3c6149800 (cpu 0) has reached its deadline 4296589836, at 4296589837 00000100:00000040:1.0:1789499363.611720:0:22792:0:(connection.c:75:cpu_latency_work()) work item of ffff9ab3c6149910 (cpu 1) has reached its deadline 4296589836, at 4296589837 00000100:00000010:0.0:1789499363.611720:0:23949:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9ab4020d4240. 00000100:00000010:1.0:1789499363.611729:0:22792:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9ab4020d4cc0. 00000100:00000040:2.0:1789499363.612428:0:33278:0:(connection.c:75:cpu_latency_work()) work item of ffff9ab3c6149a20 (cpu 2) has reached its deadline 4296589836, at 4296589837 00000100:00000010:2.0:1789499363.612572:0:33278:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9ab4020d40c0. 00000100:00000040:3.0:1789499363.612670:0:27776:0:(connection.c:75:cpu_latency_work()) work item of ffff9ab3c6149b30 (cpu 3) has reached its deadline 4296589836, at 4296589837 00000100:00000010:3.0:1789499363.612677:0:27776:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9ab4020d42a0. 00000800:00000001:1.0:1789499364.012568:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012583:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1789499364.012587:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012590:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012603:0:3606:0:(lib-move.c:4645:lnet_parse()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp) <- 192.168.206.27@tcp : PUT - for me 00000400:00000200:1.0:1789499364.012619:0:3606:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.206.27@tcp of length 224 into portal 26 MB=0x6aa9908d1e500 00000400:00000200:1.0:1789499364.012626:0:3606:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-192.168.206.27@tcp of length 224/224 into md 0x34ea1 [2] + 0 00000400:00000010:1.0:1789499364.012631:0:3606:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec4dbdc0. 00000400:00000200:1.0:1789499364.012636:0:3606:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff9ab3c54620c0 00000800:00000001:1.0:1789499364.012642:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012658:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012661:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.012666:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000400:00000200:1.0:1789499364.012672:0:3606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c54620c0 00000400:00000010:1.0:1789499364.012675:0:3606:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at ffff9ab3c54620c0. 00000100:00000001:1.0:1789499364.012681:0:3606:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1789499364.012683:0:3606:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1789499364.012687:0:3606:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c48ee450 x1876424114955520 msgsize 224 00000100:00100000:1.0:1789499364.012691:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00000040:1.0:1789499364.012694:0:3606:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1789499364.012712:0:3606:0:(events.c:377:request_in_callback()) Process leaving 00000800:00000001:1.0:1789499364.012719:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012723:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1789499364.012725:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012734:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012739:0:3606:0:(lib-move.c:4645:lnet_parse()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp) <- 192.168.206.27@tcp : PUT - for me 00000400:00000200:1.0:1789499364.012746:0:3606:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.206.27@tcp of length 224 into portal 12 MB=0x6aa9908d1e580 00000400:00000200:1.0:1789499364.012752:0:3606:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-192.168.206.27@tcp of length 224/224 into md 0x289 [64] + 20608 00000800:00000001:1.0:1789499364.012756:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012759:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012761:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.012765:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000100:00000001:1.0:1789499364.012769:0:3606:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1789499364.012770:0:3606:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:1.0:1789499364.012775:0:3606:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c8380. 00000100:00000040:1.0:1789499364.012778:0:3606:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c27c8380 x1876424114955648 msgsize 224 00000100:00100000:1.0:1789499364.012782:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00000001:1.0:1789499364.012795:0:3606:0:(events.c:377:request_in_callback()) Process leaving 00000800:00000001:1.0:1789499364.012799:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012802:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1789499364.012804:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012807:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012812:0:3606:0:(lib-move.c:4645:lnet_parse()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp) <- 192.168.206.27@tcp : PUT - for me 00000400:00000200:1.0:1789499364.012818:0:3606:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.206.27@tcp of length 224 into portal 12 MB=0x6aa9908d1e600 00000400:00000200:1.0:1789499364.012822:0:3606:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-192.168.206.27@tcp of length 224/224 into md 0x289 [64] + 20832 00000800:00000001:1.0:1789499364.012826:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000800:00000001:1.0:1789499364.012829:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499364.012831:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.012835:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000100:00000001:0.0:1789499364.012835:0:6482:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:1.0:1789499364.012841:0:3606:0:(events.c:290:request_in_callback()) Process entered 00000100:00100000:0.0:1789499364.012841:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424114955648 00000100:00000200:1.0:1789499364.012843:0:3606:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 02000000:00000001:0.0:1789499364.012846:0:6482:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000010:1.0:1789499364.012848:0:3606:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27cb100. 00000100:00000001:0.0:1789499364.012850:0:6482:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000040:1.0:1789499364.012852:0:3606:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c27cb100 x1876424114955776 msgsize 224 00000100:00000001:0.0:1789499364.012853:0:6482:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1789499364.012860:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 02000000:00000001:0.0:1789499364.012861:0:6482:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499364.012867:0:3606:0:(events.c:377:request_in_callback()) Process leaving 00000100:00100000:0.0:1789499364.012867:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424114955648 00000800:00000001:1.0:1789499364.012872:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000020:00000001:0.0:1789499364.012872:0:6482:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1789499364.012876:0:6482:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0378f7 00000800:00000001:1.0:1789499364.012877:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499364.012879:0:6482:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1789499364.012883:0:6482:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c5524000 refcount=6 00000800:00000001:1.0:1789499364.012884:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000020:00000001:0.0:1789499364.012888:0:6482:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691338199040 : -111382371352576 : ffff9ab2c5524000) 00000800:00000001:1.0:1789499364.012889:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499364.012892:0:6482:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691338199040 : -111382371352576 : ffff9ab2c5524000) 00000400:00000200:1.0:1789499364.012911:0:3606:0:(lib-move.c:4645:lnet_parse()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp) <- 192.168.206.27@tcp : PUT - for me 00000100:00000001:0.0:1789499364.012912:0:6482:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1789499364.012917:0:6482:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103500. 00000400:00000200:1.0:1789499364.012922:0:3606:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-192.168.206.27@tcp of length 224 into portal 28 MB=0x6aa9908d1e680 00000020:00000010:0.0:1789499364.012922:0:6482:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab3f5103e40. 00000020:00000040:0.0:1789499364.012928:0:6482:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00000400:00000200:1.0:1789499364.012933:0:3606:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1c from 12345-192.168.206.27@tcp of length 224/224 into md 0x28709 [8] + 6272 00000800:00000001:1.0:1789499364.012938:0:3606:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000100:00000001:0.0:1789499364.012940:0:6482:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000100:00000001:2.0:1789499364.012944:0:34655:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000020:00000010:0.0:1789499364.012945:0:6482:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418c00. 00000100:00100000:2.0:1789499364.012948:0:34655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424114955520 02000000:00000001:2.0:1789499364.012951:0:34655:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000020:00000010:0.0:1789499364.012951:0:6482:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329000. 00000100:00000001:2.0:1789499364.012954:0:34655:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789499364.012955:0:34655:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499364.012958:0:34655:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499364.012960:0:34655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424114955520 00000020:00000001:2.0:1789499364.012963:0:34655:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1789499364.012965:0:34655:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0376f1 00000020:00000010:0.0:1789499364.012966:0:6482:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000020:00000001:2.0:1789499364.012967:0:34655:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1789499364.012972:0:34655:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab4009d0000 refcount=10 00000020:00000001:2.0:1789499364.012975:0:34655:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632696627920896 : -111377081630720 : ffff9ab4009d0000) 00000020:00000001:2.0:1789499364.012978:0:34655:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632696627920896 : -111377081630720 : ffff9ab4009d0000) 00000100:00000040:0.0:1789499364.012980:0:6482:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +45s 00000100:00000001:2.0:1789499364.012981:0:34655:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:0.0:1789499364.012986:0:6482:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000020:00000010:2.0:1789499364.012987:0:34655:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c6093b80. 00000100:00000001:0.0:1789499364.012988:0:6482:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1789499364.012991:0:34655:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499364.012993:0:6482:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:2.0:1789499364.012994:0:34655:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c6093b80. 00000020:00000010:2.0:1789499364.013001:0:34655:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3f528ac00. 00000100:00000001:0.0:1789499364.013002:0:6482:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000010:2.0:1789499364.013005:0:34655:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3f85bda80. 00000100:00000001:0.0:1789499364.013006:0:6482:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000020:00000010:2.0:1789499364.013010:0:34655:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3f41b7a28. 00000100:00000001:0.0:1789499364.013010:0:6482:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499364.013019:0:34655:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:0.0:1789499364.013020:0:6482:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499364.013022:0:34655:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1789499364.013024:0:34655:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1789499364.013027:0:34655:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499364.013031:0:34655:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013035:0:6482:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1789499364.013038:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424114955776 02000000:00000001:0.0:1789499364.013039:0:6482:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1789499364.013041:0:34655:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499364.013041:0:6482:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499364.013043:0:6482:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499364.013052:0:34655:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789499364.013054:0:34655:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1789499364.013059:0:34655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00000040:2.0:1789499364.013062:0:34655:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab4009d0000 : new rpc_count 1 02000000:00000001:0.0:1789499364.013065:0:6482:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499364.013066:0:34655:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691325396048 : -111382384155568 : ffff9ab2c48ee450) 00000100:00100000:0.0:1789499364.013070:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424114955776 00000020:00000001:0.0:1789499364.013073:0:6482:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1789499364.013075:0:6482:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffc20f 00000100:00000040:2.0:1789499364.013076:0:34655:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c48ee450 x1876424114955520/t0(0) o400->18bdc1c4-129c-401b-abb7-9e312abc5cbc@192.168.206.27@tcp:640/0 lens 224/0 e 0 to 0 dl 1789499375 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:0.0:1789499364.013077:0:6482:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1789499364.013080:0:6482:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c4740000 refcount=8 00000020:00000001:0.0:1789499364.013082:0:6482:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691323633664 : -111382385917952 : ffff9ab2c4740000) 00000020:00000001:0.0:1789499364.013086:0:6482:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691323633664 : -111382385917952 : ffff9ab2c4740000) 00000100:00000001:0.0:1789499364.013091:0:6482:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1789499364.013094:0:6482:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103e40. 00000100:00000001:2.0:1789499364.013098:0:34655:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1789499364.013102:0:34655:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c6093b80. 00000020:00000010:0.0:1789499364.013103:0:6482:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c48160c0. 00000100:00000001:2.0:1789499364.013105:0:34655:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1789499364.013108:0:34655:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c6093b80. 00000100:00100000:2.0:1789499364.013114:0:34655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c48ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18bdc1c4-129c-401b-abb7-9e312abc5cbc+10:2392:x1876424114955520:12345-192.168.206.27@tcp:400:kworker.0 00000020:00000040:0.0:1789499364.013114:0:6482:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff9ab3ed933380) now 12 - evictor 00000100:00000200:2.0:1789499364.013120:0:34655:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424114955520 00000100:00000001:0.0:1789499364.013121:0:6482:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000001:2.0:1789499364.013126:0:34655:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000010:0.0:1789499364.013127:0:6482:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec419c00. 00000020:00000010:0.0:1789499364.013131:0:6482:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329f80. 00000020:00000001:2.0:1789499364.013132:0:34655:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000010:0.0:1789499364.013133:0:6482:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235190. 00000020:00000001:2.0:1789499364.013135:0:34655:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013137:0:6482:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000020:00000001:2.0:1789499364.013140:0:34655:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000001:0.0:1789499364.013140:0:6482:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000020:00000001:2.0:1789499364.013144:0:34655:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072663275712 : -1046275904 : ffffffffc1a318c0) 00000100:00000001:0.0:1789499364.013144:0:6482:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499364.013146:0:6482:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000001:2.0:1789499364.013149:0:34655:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000001:0.0:1789499364.013149:0:6482:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:0.0:1789499364.013150:0:6482:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013153:0:34655:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789499364.013157:0:34655:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1789499364.013159:0:34655:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000001:0.0:1789499364.013159:0:6482:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789499364.013165:0:34655:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013168:0:34655:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499364.013169:0:6482:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789499364.013171:0:34655:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000100:00000001:0.0:1789499364.013172:0:6482:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 02000000:00000001:2.0:1789499364.013175:0:34655:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00100000:0.0:1789499364.013179:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2845 02000000:00000010:2.0:1789499364.013182:0:34655:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c373f000. 00000100:00000040:0.0:1789499364.013183:0:6482:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c5524000 : new rpc_count 1 02000000:00000001:2.0:1789499364.013186:0:34655:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013188:0:6482:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691290637184 : -111382418914432 : ffff9ab2c27c8380) 00000100:00000001:2.0:1789499364.013190:0:34655:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013194:0:34655:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499364.013197:0:6482:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c27c8380 x1876424114955648/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/0 e 0 to 0 dl 1789499414 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1789499364.013198:0:34655:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424114955520 00010000:00000001:2.0:1789499364.013203:0:34655:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:2.0:1789499364.013209:0:34655:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c48ee450 x1876424114955520/t0(0) o400->18bdc1c4-129c-401b-abb7-9e312abc5cbc@192.168.206.27@tcp:640/0 lens 224/224 e 0 to 0 dl 1789499375 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499364.013221:0:6482:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00010000:00000001:2.0:1789499364.013223:0:34655:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000020:00000010:0.0:1789499364.013226:0:6482:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103940. 00010000:00000001:2.0:1789499364.013227:0:34655:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013231:0:6482:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00001000:2.0:1789499364.013233:0:34655:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcd985e8 time=76 v=5 (1 0 0 0) 00000100:00000001:2.0:1789499364.013237:0:34655:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000020:00000010:0.0:1789499364.013242:0:6482:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103940. 00000100:00000040:2.0:1789499364.013243:0:34655:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab2c31638c0 refcount 9 to 192.168.206.27@tcp 00000100:00100000:0.0:1789499364.013249:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c27c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7853081-acbf-409b-bc4d-346cf5f507eb+6:2392:x1876424114955648:12345-192.168.206.27@tcp:400:kworker.0 00000100:00000001:2.0:1789499364.013254:0:34655:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632691300710592 : -111382408841024 : ffff9ab2c31638c0) 00000100:00000200:0.0:1789499364.013256:0:6482:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424114955648 02000000:00000001:2.0:1789499364.013259:0:34655:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000020:00000001:0.0:1789499364.013260:0:6482:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 02000000:00000001:2.0:1789499364.013262:0:34655:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013264:0:6482:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000001:2.0:1789499364.013267:0:34655:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000001:0.0:1789499364.013269:0:6482:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013273:0:6482:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000040:2.0:1789499364.013274:0:34655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.27@tcp 00000020:00000001:0.0:1789499364.013277:0:6482:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000400:00000010:2.0:1789499364.013280:0:34655:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2198. 00000020:00000001:0.0:1789499364.013281:0:6482:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000001:00000001:0.0:1789499364.013286:0:6482:0:(tgt_lastrcvd.c:2394:tgt_lookup_reply()) lustre-MDT0000: lookup reply xid 1876424114955648, found 0 last_xid 1876424114955647 00000100:00000200:2.0:1789499364.013288:0:34655:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1876424114955520, offset 224 00000020:00000001:0.0:1789499364.013290:0:6482:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499364.013293:0:6482:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1789499364.013295:0:6482:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000400:00000200:2.0:1789499364.013297:0:34655:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-192.168.206.27@tcp 00000020:00000001:0.0:1789499364.013298:0:6482:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013301:0:6482:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499364.013306:0:6482:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1789499364.013307:0:6482:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1789499364.013311:0:6482:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c35f1400. 00000400:00000200:2.0:1789499364.013313:0:34655:0:(lib-move.c:2806:lnet_handle_send_case_locked()) Source Specified: 192.168.206.127@tcp to MR: 192.168.206.27@tcp local destination 02000000:00000001:0.0:1789499364.013315:0:6482:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013318:0:6482:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499364.013322:0:34655:0:(lib-move.c:1738:lnet_handle_send()) 192.168.206.127@tcp NI seq info: [17967:17967:256:4294967295] 192.168.206.27@tcp LPNI seq info [17963:17963:8:4294967295] 00000020:00000001:0.0:1789499364.013323:0:6482:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1789499364.013328:0:6482:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424114955648 00010000:00000001:0.0:1789499364.013331:0:6482:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:0.0:1789499364.013338:0:6482:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c27c8380 x1876424114955648/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/224 e 0 to 0 dl 1789499414 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1789499364.013339:0:34655:0:(lib-move.c:1854:lnet_handle_send()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp:192.168.206.127@tcp) -> 192.168.206.27@tcp(192.168.206.27@tcp:192.168.206.27@tcp) : PUT try# 0 00000800:00000200:2.0:1789499364.013351:0:34655:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.206.27@tcp 00000800:00000010:2.0:1789499364.013357:0:34655:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9ab3c2f57d00. 00010000:00000001:0.0:1789499364.013362:0:6482:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000800:00000200:2.0:1789499364.013364:0:34655:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9ab3fcfbfb40] -> 12345-192.168.206.27@tcp (4) 00010000:00000001:0.0:1789499364.013366:0:6482:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1789499364.013370:0:6482:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=28 v=36 (1 36 4 1) 00000800:00000200:2.0:1789499364.013373:0:34655:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.206.27@tcp ip 192.168.206.27:1023 00000100:00000001:0.0:1789499364.013375:0:6482:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000800:00000200:2.0:1789499364.013379:0:34655:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffff9ab3c2f57d00 type 1, nob 320 niov 1 nkiov 1 00000100:00000040:0.0:1789499364.013381:0:6482:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab2c31638c0 refcount 10 to 192.168.206.27@tcp 00000100:00000001:0.0:1789499364.013384:0:6482:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632691300710592 : -111382408841024 : ffff9ab2c31638c0) 02000000:00000001:0.0:1789499364.013386:0:6482:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1789499364.013387:0:6482:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499364.013392:0:34655:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013394:0:6482:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789499364.013399:0:34655:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab2c31638c0 refcount 9 to 192.168.206.27@tcp 00000100:00000040:0.0:1789499364.013399:0:6482:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.27@tcp 00000400:00000010:0.0:1789499364.013403:0:6482:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970a18. 00010000:00000001:2.0:1789499364.013404:0:34655:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000100:00000200:0.0:1789499364.013407:0:6482:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424114955648, offset 224 00000020:00000001:2.0:1789499364.013408:0:34655:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013412:0:34655:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000400:00000200:0.0:1789499364.013413:0:6482:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-192.168.206.27@tcp 00000100:00000040:2.0:1789499364.013419:0:34655:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c48ee450 x1876424114955520/t0(0) o400->18bdc1c4-129c-401b-abb7-9e312abc5cbc@192.168.206.27@tcp:640/0 lens 224/224 e 0 to 0 dl 1789499375 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499364.013422:0:6482:0:(lib-move.c:2806:lnet_handle_send_case_locked()) Source Specified: 192.168.206.127@tcp to MR: 192.168.206.27@tcp local destination 00000400:00000200:0.0:1789499364.013430:0:6482:0:(lib-move.c:1738:lnet_handle_send()) 192.168.206.127@tcp NI seq info: [17968:17968:255:4294967295] 192.168.206.27@tcp LPNI seq info [17964:17964:7:4294967295] 00000100:00100000:2.0:1789499364.013441:0:34655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c48ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18bdc1c4-129c-401b-abb7-9e312abc5cbc+10:2392:x1876424114955520:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 341us (751us total) trans 0 rc 0/0 00000400:00000200:0.0:1789499364.013452:0:6482:0:(lib-move.c:1854:lnet_handle_send()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp:192.168.206.127@tcp) -> 192.168.206.27@tcp(192.168.206.27@tcp:192.168.206.27@tcp) : PUT try# 0 00000100:00100000:2.0:1789499364.013456:0:34655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00000040:2.0:1789499364.013461:0:34655:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab4009d0000 : new rpc_count 0 00000800:00000200:0.0:1789499364.013462:0:6482:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.206.27@tcp 00000100:00000001:2.0:1789499364.013464:0:34655:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789499364.013467:0:34655:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000800:00000010:0.0:1789499364.013469:0:6482:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9ab3fcf67400. 00000800:00000200:0.0:1789499364.013475:0:6482:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9ab3fcfbfb40] -> 12345-192.168.206.27@tcp (4) 00000020:00000010:2.0:1789499364.013478:0:34655:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3f85bda80. 00000800:00000200:0.0:1789499364.013483:0:6482:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.206.27@tcp ip 192.168.206.27:1023 00000020:00000010:2.0:1789499364.013485:0:34655:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3f41b7a28. 00000800:00000200:0.0:1789499364.013488:0:6482:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffff9ab3fcf67400 type 1, nob 320 niov 1 nkiov 1 00000020:00000010:2.0:1789499364.013490:0:34655:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3f528ac00. 00000100:00000001:0.0:1789499364.013493:0:6482:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:2.0:1789499364.013496:0:34655:0:(genops.c:879:class_export_put()) PUTting export ffff9ab4009d0000 : new refcount 9 00000100:00000040:0.0:1789499364.013499:0:6482:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab2c31638c0 refcount 8 to 192.168.206.27@tcp 00000100:00000001:2.0:1789499364.013502:0:34655:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1789499364.013503:0:6482:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:0.0:1789499364.013506:0:6482:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1789499364.013508:0:34655:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000020:00000001:0.0:1789499364.013509:0:6482:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000400:00000010:2.0:1789499364.013516:0:34655:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec583948. 00000100:00000040:0.0:1789499364.013516:0:6482:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c8380 x1876424114955648/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/224 e 0 to 0 dl 1789499414 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1789499364.013523:0:34655:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff9ab2c2623b40. 00000100:00100000:0.0:1789499364.013532:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c27c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7853081-acbf-409b-bc4d-346cf5f507eb+6:2392:x1876424114955648:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 309us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789499364.013539:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2845 00000100:00000040:0.0:1789499364.013542:0:6482:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c5524000 : new rpc_count 0 00000100:00000001:2.0:1789499364.013545:0:16741:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1789499364.013545:0:6482:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789499364.013548:0:16741:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:0.0:1789499364.013549:0:6482:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1789499364.013554:0:6482:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329000. 00000100:00100000:2.0:1789499364.013557:0:16741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2846 00000020:00000010:0.0:1789499364.013559:0:6482:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000100:00000040:2.0:1789499364.013561:0:16741:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c4740000 : new rpc_count 1 00000800:00000001:1.0:1789499364.013561:0:3606:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499364.013564:0:16741:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691290648832 : -111382418902784 : ffff9ab2c27cb100) 00000020:00000010:0.0:1789499364.013564:0:6482:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418c00. 00000400:00000200:1.0:1789499364.013565:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000040:0.0:1789499364.013570:0:6482:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c5524000 : new refcount 5 00000400:00000200:1.0:1789499364.013571:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000100:00000040:2.0:1789499364.013572:0:16741:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c27cb100 x1876424114955776/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/0 e 0 to 0 dl 1789499414 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499364.013576:0:3606:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1789499364.013578:0:3606:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost 00000100:00000001:0.0:1789499364.013582:0:6482:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499364.013583:0:16741:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000010:1.0:1789499364.013583:0:3606:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27cb480. 00000020:00000010:2.0:1789499364.013586:0:16741:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c6093b80. 00000100:00000040:1.0:1789499364.013588:0:3606:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c27cb480 x1876424114955904 msgsize 224 00000100:00000001:2.0:1789499364.013589:0:16741:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1789499364.013592:0:16741:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c6093b80. 00000100:00100000:1.0:1789499364.013592:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1789499364.013596:0:16741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c27cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e7853081-acbf-409b-bc4d-346cf5f507eb+8:2392:x1876424114955776:12345-192.168.206.27@tcp:400:kworker.0 00000100:00000200:2.0:1789499364.013600:0:16741:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424114955776 00000100:00000001:1.0:1789499364.013601:0:3606:0:(events.c:377:request_in_callback()) Process leaving 00000020:00000001:2.0:1789499364.013602:0:16741:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1789499364.013609:0:16741:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1789499364.013612:0:16741:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013614:0:16741:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1789499364.013616:0:16741:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000020:00000001:2.0:1789499364.013618:0:16741:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000001:00000001:2.0:1789499364.013620:0:16741:0:(tgt_lastrcvd.c:2394:tgt_lookup_reply()) lustre-MDT0001: lookup reply xid 1876424114955776, found 0 last_xid 1876424114955775 00000020:00000001:2.0:1789499364.013622:0:16741:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789499364.013624:0:16741:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000800:00000001:0.0:1789499364.013624:0:3608:0:(socklnd_cb.c:281:ksocknal_receive()) Process entered 00000020:00000001:2.0:1789499364.013627:0:16741:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000800:00000200:1.0:1789499364.013628:0:3606:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000001:0.0:1789499364.013631:0:3608:0:(socklnd_cb.c:314:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000010:1.0:1789499364.013632:0:3606:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9ab3c2f57d00. 00000020:00000001:2.0:1789499364.013634:0:16741:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013637:0:16741:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000400:00000200:1.0:1789499364.013638:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:2.0:1789499364.013639:0:16741:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1789499364.013641:0:16741:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000400:00000200:1.0:1789499364.013642:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 02000000:00000010:2.0:1789499364.013644:0:16741:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c373d400. 00000400:00000200:1.0:1789499364.013662:0:3606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2198 02000000:00000001:2.0:1789499364.013663:0:16741:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1789499364.013664:0:3606:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2198. 00000100:00000001:2.0:1789499364.013665:0:16741:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013668:0:16741:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499364.013668:0:3606:0:(events.c:390:reply_out_callback()) Process entered 00010000:00000040:2.0:1789499364.013670:0:16741:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967348, transno 0, xid 1876424114955776 02000000:00000001:1.0:1789499364.013670:0:3606:0:(sec.c:2664:sptlrpc_svc_free_rs()) Process entered 00000100:00000001:0.0:1789499364.013671:0:16740:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00010000:00000001:2.0:1789499364.013673:0:16741:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 02000000:00000010:1.0:1789499364.013673:0:3606:0:(sec_null.c:327:null_free_rs()) kvfree 'rs': 520 at ffff9ab2c373f000. 00000100:00100000:0.0:1789499364.013674:0:16740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424114955904 02000000:00000001:0.0:1789499364.013677:0:16740:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00010000:00000200:2.0:1789499364.013679:0:16741:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c27cb100 x1876424114955776/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/224 e 0 to 0 dl 1789499414 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499364.013679:0:16740:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499364.013681:0:16740:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499364.013683:0:3606:0:(sec.c:2677:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1789499364.013686:0:3606:0:(events.c:402:reply_out_callback()) Process leaving 02000000:00000001:0.0:1789499364.013686:0:16740:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789499364.013691:0:16740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424114955904 00010000:00000001:2.0:1789499364.013692:0:16741:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000020:00000001:0.0:1789499364.013693:0:16740:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1789499364.013695:0:16740:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffef88 00010000:00000001:2.0:1789499364.013696:0:16741:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013697:0:16740:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00001000:2.0:1789499364.013701:0:16741:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=28 v=36 (1 36 4 1) 00000020:00000040:0.0:1789499364.013701:0:16740:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab3e0bc7800 refcount=6 00000020:00000001:0.0:1789499364.013705:0:16740:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632696093112320 : -111377616439296 : ffff9ab3e0bc7800) 00000100:00000001:2.0:1789499364.013708:0:16741:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000020:00000001:0.0:1789499364.013708:0:16740:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632696093112320 : -111377616439296 : ffff9ab3e0bc7800) 00000100:00000001:0.0:1789499364.013712:0:16740:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:2.0:1789499364.013714:0:16741:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab2c31638c0 refcount 9 to 192.168.206.27@tcp 00000020:00000010:0.0:1789499364.013716:0:16740:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103940. 00000100:00000001:2.0:1789499364.013719:0:16741:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632691300710592 : -111382408841024 : ffff9ab2c31638c0) 00000020:00000010:0.0:1789499364.013720:0:16740:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab3f5103a80. 02000000:00000001:2.0:1789499364.013725:0:16741:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000020:00000040:0.0:1789499364.013726:0:16740:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff9ab3f5dfb380) now 10 - evictor 02000000:00000001:2.0:1789499364.013728:0:16741:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013729:0:16740:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000100:00000001:2.0:1789499364.013732:0:16741:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000010:0.0:1789499364.013733:0:16740:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418c00. 00000100:00000040:2.0:1789499364.013737:0:16741:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.27@tcp 00000020:00000010:0.0:1789499364.013738:0:16740:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329000. 00000400:00000010:2.0:1789499364.013741:0:16741:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2770. 00000100:00000200:2.0:1789499364.013746:0:16741:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424114955776, offset 224 00000020:00000010:0.0:1789499364.013747:0:16740:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000400:00000200:2.0:1789499364.013754:0:16741:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-192.168.206.27@tcp 00000100:00000040:0.0:1789499364.013754:0:16740:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000001:0.0:1789499364.013756:0:16740:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1789499364.013758:0:16740:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1789499364.013760:0:16740:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1789499364.013763:0:16741:0:(lib-move.c:2806:lnet_handle_send_case_locked()) Source Specified: 192.168.206.127@tcp to MR: 192.168.206.27@tcp local destination 00000100:00000001:0.0:1789499364.013764:0:16740:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:0.0:1789499364.013767:0:16740:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:0.0:1789499364.013769:0:16740:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499364.013773:0:16741:0:(lib-move.c:1738:lnet_handle_send()) 192.168.206.127@tcp NI seq info: [17969:17969:255:4294967295] 192.168.206.27@tcp LPNI seq info [17965:17965:7:4294967295] 00000100:00000001:0.0:1789499364.013776:0:16740:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499364.013784:0:16740:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000400:00000200:2.0:1789499364.013785:0:16741:0:(lib-move.c:1854:lnet_handle_send()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp:192.168.206.127@tcp) -> 192.168.206.27@tcp(192.168.206.27@tcp:192.168.206.27@tcp) : PUT try# 0 00000100:00000001:0.0:1789499364.013786:0:16740:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1789499364.013793:0:16740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1451 00000800:00000200:2.0:1789499364.013795:0:16741:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.206.27@tcp 00000800:00000010:2.0:1789499364.013799:0:16741:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9ab3c2f57b00. 00000800:00000200:2.0:1789499364.013805:0:16741:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9ab3fcfbfb40] -> 12345-192.168.206.27@tcp (4) 00000100:00000040:0.0:1789499364.013805:0:16740:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab3e0bc7800 : new rpc_count 1 00000100:00000001:0.0:1789499364.013810:0:16740:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691290649728 : -111382418901888 : ffff9ab2c27cb480) 00000800:00000200:2.0:1789499364.013814:0:16741:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.206.27@tcp ip 192.168.206.27:1023 00000100:00000040:0.0:1789499364.013819:0:16740:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c27cb480 x1876424114955904/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:640/0 lens 224/0 e 0 to 0 dl 1789499375 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:2.0:1789499364.013825:0:16741:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffff9ab3c2f57b00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1789499364.013832:0:16741:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013834:0:16740:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:2.0:1789499364.013838:0:16741:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab2c31638c0 refcount 8 to 192.168.206.27@tcp 00000020:00000010:0.0:1789499364.013839:0:16740:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103a80. 00010000:00000001:2.0:1789499364.013841:0:16741:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000100:00000001:0.0:1789499364.013844:0:16740:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000001:2.0:1789499364.013845:0:16741:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499364.013850:0:16741:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000020:00000010:0.0:1789499364.013850:0:16740:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103a80. 00000100:00000040:2.0:1789499364.013857:0:16741:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27cb100 x1876424114955776/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:679/0 lens 224/224 e 0 to 0 dl 1789499414 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499364.013859:0:16740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c27cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7853081-acbf-409b-bc4d-346cf5f507eb+6:2391:x1876424114955904:12345-192.168.206.27@tcp:400:kworker.0 00000100:00000200:0.0:1789499364.013869:0:16740:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424114955904 00000020:00000001:0.0:1789499364.013873:0:16740:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000100:00100000:2.0:1789499364.013878:0:16741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c27cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e7853081-acbf-409b-bc4d-346cf5f507eb+8:2392:x1876424114955776:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 291us (1021us total) trans 0 rc 0/0 00000020:00000001:0.0:1789499364.013878:0:16740:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1789499364.013881:0:16740:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013885:0:16740:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1789499364.013889:0:16740:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000100:00100000:2.0:1789499364.013890:0:16741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2846 00000020:00000001:0.0:1789499364.013903:0:16740:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000040:2.0:1789499364.013905:0:16741:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c4740000 : new rpc_count 0 00000020:00000001:0.0:1789499364.013907:0:16740:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499364.013909:0:16741:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789499364.013913:0:16741:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000001:0.0:1789499364.013913:0:16740:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1789499364.013916:0:16740:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000010:2.0:1789499364.013918:0:16741:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329f80. 00000020:00000001:0.0:1789499364.013919:0:16740:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013924:0:16740:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000020:00000010:2.0:1789499364.013925:0:16741:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235190. 00000100:00000001:0.0:1789499364.013926:0:16740:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000020:00000010:2.0:1789499364.013929:0:16741:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec419c00. 02000000:00000001:0.0:1789499364.013930:0:16740:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000020:00000040:2.0:1789499364.013935:0:16741:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c4740000 : new refcount 7 02000000:00000010:0.0:1789499364.013938:0:16740:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c377c400. 00000100:00000001:2.0:1789499364.013939:0:16741:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:0.0:1789499364.013944:0:16740:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.013947:0:16740:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.013950:0:16740:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1789499364.013952:0:16740:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294968921, transno 0, xid 1876424114955904 00010000:00000001:0.0:1789499364.013954:0:16740:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00080000:2.0:1789499364.013958:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00000200:0.0:1789499364.013959:0:16740:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c27cb480 x1876424114955904/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:640/0 lens 224/224 e 0 to 0 dl 1789499375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1789499364.013963:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff9ab3f5dfb380) now 10 - evictor 00000100:00080000:2.0:1789499364.013969:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000001:0.0:1789499364.013972:0:16740:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000020:00000040:2.0:1789499364.013973:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff9ab3ed933380) now 12 - evictor 00000100:00080000:2.0:1789499364.013975:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1789499364.013977:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00010000:00000001:0.0:1789499364.013981:0:16740:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1789499364.013986:0:16740:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3ee9489e8 time=11 v=5 (1 1 1 1) 00000100:00000001:0.0:1789499364.013990:0:16740:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1789499364.013993:0:16740:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab2c31638c0 refcount 9 to 192.168.206.27@tcp 00000100:00000001:0.0:1789499364.013995:0:16740:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632691300710592 : -111382408841024 : ffff9ab2c31638c0) 02000000:00000001:0.0:1789499364.013998:0:16740:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1789499364.014000:0:16740:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499364.014002:0:16740:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1789499364.014004:0:16740:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.27@tcp 00000400:00000010:0.0:1789499364.014008:0:16740:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970660. 00000100:00000200:0.0:1789499364.014011:0:16740:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424114955904, offset 224 00000400:00000200:0.0:1789499364.014015:0:16740:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-192.168.206.27@tcp 00000400:00000200:0.0:1789499364.014022:0:16740:0:(lib-move.c:2806:lnet_handle_send_case_locked()) Source Specified: 192.168.206.127@tcp to MR: 192.168.206.27@tcp local destination 00000400:00000200:0.0:1789499364.014025:0:16740:0:(lib-move.c:1738:lnet_handle_send()) 192.168.206.127@tcp NI seq info: [17970:17970:254:4294967295] 192.168.206.27@tcp LPNI seq info [17966:17966:6:4294967295] 00000400:00000200:0.0:1789499364.014034:0:16740:0:(lib-move.c:1854:lnet_handle_send()) TRACE: 192.168.206.127@tcp(192.168.206.127@tcp:192.168.206.127@tcp) -> 192.168.206.27@tcp(192.168.206.27@tcp:192.168.206.27@tcp) : PUT try# 0 00000800:00000200:0.0:1789499364.014038:0:16740:0:(socklnd_cb.c:931:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.206.27@tcp 00000800:00000010:0.0:1789499364.014042:0:16740:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9ab3fcf67d00. 00000800:00000200:0.0:1789499364.014046:0:16740:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9ab3fcfbfb40] -> 12345-192.168.206.27@tcp (4) 00000800:00000200:0.0:1789499364.014050:0:16740:0:(socklnd_cb.c:678:ksocknal_queue_tx_locked()) Sending to 12345-192.168.206.27@tcp ip 192.168.206.27:1023 00000800:00000200:0.0:1789499364.014052:0:16740:0:(socklnd_cb.c:697:ksocknal_queue_tx_locked()) Packet ffff9ab3fcf67d00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1789499364.014055:0:16740:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499364.014058:0:16740:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab2c31638c0 refcount 8 to 192.168.206.27@tcp 00010000:00000001:0.0:1789499364.014059:0:16740:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:0.0:1789499364.014061:0:16740:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.014063:0:16740:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1789499364.014067:0:16740:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27cb480 x1876424114955904/t0(0) o400->e7853081-acbf-409b-bc4d-346cf5f507eb@192.168.206.27@tcp:640/0 lens 224/224 e 0 to 0 dl 1789499375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499364.014076:0:16740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c27cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7853081-acbf-409b-bc4d-346cf5f507eb+6:2391:x1876424114955904:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 241us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789499364.014082:0:16740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1451 00000100:00000040:0.0:1789499364.014091:0:16740:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab3e0bc7800 : new rpc_count 0 00000100:00000001:0.0:1789499364.014093:0:16740:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1789499364.014094:0:16740:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1789499364.014097:0:16740:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329000. 00000020:00000010:0.0:1789499364.014099:0:16740:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000020:00000010:0.0:1789499364.014102:0:16740:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418c00. 00000020:00000040:0.0:1789499364.014104:0:16740:0:(genops.c:879:class_export_put()) PUTting export ffff9ab3e0bc7800 : new refcount 5 00000100:00000001:0.0:1789499364.014106:0:16740:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:1.0:1789499364.014239:0:3606:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1789499364.014242:0:3606:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9ab3fcf67400. 00000400:00000200:1.0:1789499364.014245:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.014247:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000400:00000200:1.0:1789499364.014257:0:3606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970a18 00000400:00000010:1.0:1789499364.014258:0:3606:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970a18. 00000100:00000001:1.0:1789499364.014260:0:3606:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1789499364.014328:0:3606:0:(events.c:402:reply_out_callback()) Process leaving 00000800:00000200:1.0:1789499364.014345:0:3606:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1789499364.014351:0:3606:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9ab3c2f57b00. 00000400:00000200:1.0:1789499364.014353:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.014355:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000400:00000200:1.0:1789499364.014357:0:3606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2770 00000400:00000010:1.0:1789499364.014358:0:3606:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2770. 00000100:00000001:1.0:1789499364.014360:0:3606:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1789499364.014361:0:3606:0:(events.c:402:reply_out_callback()) Process leaving 00000800:00000200:1.0:1789499364.014518:0:3606:0:(socklnd_cb.c:469:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1789499364.014521:0:3606:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9ab3fcf67d00. 00000400:00000200:1.0:1789499364.014523:0:3606:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499364.014526:0:3606:0:(lib-msg.c:895:lnet_health_check()) health check: 192.168.206.127@tcp->192.168.206.27@tcp: PUT: OK 00000400:00000200:1.0:1789499364.014528:0:3606:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970660 00000400:00000010:1.0:1789499364.014529:0:3606:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970660. 00000100:00000001:1.0:1789499364.014530:0:3606:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1789499364.014531:0:3606:0:(events.c:402:reply_out_callback()) Process leaving 00010000:00000001:0.0:1789499364.046745:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499364.046752:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499364.046757:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499364.046759:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499364.046762:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499364.046764:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499364.046767:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499364.046769:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499364.046773:0:23949:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1789499364.046775:0:23949:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499364.046797:0:6471:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1789499364.046799:0:6471:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1789499364.046802:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1789499365.070705:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499365.070710:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.070714:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499365.070715:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.070718:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499365.070720:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.070722:0:23949:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:0.0:1789499365.070723:0:23949:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.070726:0:23949:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1789499365.070727:0:23949:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.070795:0:8408:0:(genops.c:1894:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1789499365.070799:0:8408:0:(genops.c:1908:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1789499365.070803:0:8408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:00000010:0.0:1789499365.109097:0:36004:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.109106:0:36004:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.109113:0:36004:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.109121:0:36004:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.109125:0:36004:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.109133:0:36004:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.109141:0:36004:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.109145:0:36004:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.109150:0:36004:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.109161:0:36004:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.109166:0:36004:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.109170:0:36004:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:1.0:1789499365.278120:0:36040:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:1.0:1789499365.278125:0:36040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: recovery-small test_29a: @@@@@@ FAIL: mds1: import is not in FULL state after 50 00000001:00000001:1.0:1789499365.282668:0:36040:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00000004:00000001:0.0:1789499365.646734:0:34666:0:(osp_precreate.c:196:osp_statfs_update()) Process entered 00000004:00000020:0.0:1789499365.646738:0:34666:0:(osp_precreate.c:198:osp_statfs_update()) going to update statfs 00000100:00000010:0.0:1789499365.646744:0:34666:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c46c7100. 00000020:00000040:0.0:1789499365.646749:0:34666:0:(genops.c:1209:class_import_get()) import ffff9ab3c7fe5800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000001:0.0:1789499365.646752:0:34666:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1789499365.646754:0:34666:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1789499365.646757:0:34666:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1789499365.646770:0:34666:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab3fcf67d00. 00000100:00000001:0.0:1789499365.646775:0:34666:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.646780:0:34666:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1789499365.646783:0:34666:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.646791:0:34666:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000024e3e603] to pc [ptlrpcd_00_00+0] req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000001:0.0:1789499365.646821:0:34666:0:(osp_precreate.c:256:osp_statfs_update()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.646853:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789499365.646857:0:3613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499365.646860:0:3613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1789499365.646865:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.646870:0:3613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1789499365.646871:0:3613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.646874:0:3613:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1789499365.646876:0:3613:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1789499365.646878:0:3613:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1789499365.646880:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c46c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876424122723712:0@lo:41:osp-pre-1-0.0 00000100:00000001:1.0:1789499365.646882:0:3613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1789499365.646898:0:3613:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1789499365.646907:0:3613:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.646909:0:3613:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1789499365.646913:0:3613:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff9ab3f865a800. 02000000:00000001:1.0:1789499365.646915:0:3613:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1789499365.646921:0:3613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3fcfbbdc0. 00000400:00000010:1.0:1789499365.646927:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4b28. 00000100:00000200:1.0:1789499365.646933:0:3613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1876424122723712, portal 4 00000100:00000001:1.0:1789499365.646936:0:3613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1789499365.646937:0:3613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691323138304 : -111382386413312 : ffff9ab2c46c7100) 00000100:00000040:1.0:1789499365.646945:0:3613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.646952:0:3613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1789499365.646955:0:3613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1789499365.646969:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4aa0. 00000100:00000200:1.0:1789499365.646972:0:3613:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1876424122723712, offset 0 00000400:00000200:1.0:1789499365.646978:0:3613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1789499365.646991:0:3613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:3.0:1789499365.646997:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:1.0:1789499365.647002:0:3613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 24 MB=0x6aa9909486d80 00000100:00000001:3.0:1789499365.647008:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.647008:0:3613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 224/224 into md 0x465 [256] + 13208 00000400:00000200:1.0:1789499365.647018:0:3613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499365.647021:0:3613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1789499365.647026:0:3613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1789499365.647027:0:3613:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:1.0:1789499365.647030:0:3613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27cb800. 00000100:00000040:1.0:1789499365.647032:0:3613:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c27cb800 x1876424122723712 msgsize 224 00000100:00100000:1.0:1789499365.647034:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1789499365.647049:0:3613:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1789499365.647057:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4aa0 00000400:00000010:1.0:1789499365.647060:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4aa0. 00000100:00000001:1.0:1789499365.647063:0:3613:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1789499365.647067:0:3613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647077:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1789499365.647080:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647093:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647095:0:3613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1789499365.647102:0:3613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647106:0:3613:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 236448 usecs (237 jiffies) 00000100:00000001:1.0:1789499365.647110:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4296592109 00000100:00000010:1.0:1789499365.647114:0:3613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d45a0. 00000100:00000001:1.0:1789499365.647120:0:3613:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request now active for cpu 0 00000100:00000001:1.0:1789499365.647126:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4296592109 00000100:00000010:1.0:1789499365.647130:0:3613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d44e0. 00000100:00000001:1.0:1789499365.647134:0:3613:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request now active for cpu 1 00000100:00000001:1.0:1789499365.647137:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4296592109 00000100:00000010:1.0:1789499365.647139:0:3613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d4a80. 00000100:00000001:1.0:1789499365.647142:0:3613:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request now active for cpu 2 00000100:00000001:1.0:1789499365.647145:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4296592109 00000100:00000010:1.0:1789499365.647148:0:3613:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9ab4020d4120. 00000100:00000001:1.0:1789499365.647151:0:3613:0:(niobuf.c:678:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request now active for cpu 3 00000100:00000001:1.0:1789499365.647154:0:3613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1789499365.647156:0:3613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647159:0:3613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647161:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.647169:0:3613:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1789499365.647171:0:3613:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1789499365.647173:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789499365.647174:0:3613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499365.647176:0:3613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647178:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647198:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) a7d51d89-6692-45db-a733-1d410e949bbe->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1789499365.647203:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1789499365.647206:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c8a80. 00000020:00000040:1.0:1789499365.647209:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3f4287000 refcount=4 obd=MGC192.168.206.127@tcp 00000100:00000001:1.0:1789499365.647212:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1789499365.647221:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.647223:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1789499365.647227:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665800. 00000100:00000001:1.0:1789499365.647231:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647236:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a7d51d89-6692-45db-a733-1d410e949bbe->MGS req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1789499365.647244:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1789499365.647247:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647252:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000044000c5a] to pc [ptlrpcd_00_01+1] req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.647256:0:6488:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1789499365.647260:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122723712 02000000:00000001:0.0:1789499365.647264:0:6488:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1789499365.647267:0:6488:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.647270:0:6488:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789499365.647274:0:6488:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789499365.647277:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122723712 00000020:00000001:0.0:1789499365.647280:0:6488:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1789499365.647282:0:6488:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc03770d 00000100:00000001:1.0:1789499365.647283:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.647284:0:6488:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000040:1.0:1789499365.647287:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1789499365.647289:0:6488:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c4742800 refcount=5 00000100:00000001:1.0:1789499365.647295:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000020:00000001:0.0:1789499365.647295:0:6488:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691323643904 : -111382385907712 : ffff9ab2c4742800) 00000020:00000001:0.0:1789499365.647300:0:6488:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691323643904 : -111382385907712 : ffff9ab2c4742800) 00000100:00000010:1.0:1789499365.647301:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c9180. 00000020:00000040:1.0:1789499365.647305:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3f5de0800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000001:0.0:1789499365.647305:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:1.0:1789499365.647308:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1789499365.647310:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.647312:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.647317:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 02000000:00000010:1.0:1789499365.647318:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665000. 00000100:00000001:1.0:1789499365.647323:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647323:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000040:1.0:1789499365.647329:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000010:0.0:1789499365.647329:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000100:00000001:1.0:1789499365.647337:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1789499365.647338:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.647339:0:6488:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418600. 00000100:00000040:1.0:1789499365.647342:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005ea58d5e] to pc [ptlrpcd_00_02+2] req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000001:3.0:1789499365.647345:0:7427:0:(osp_precreate.c:196:osp_statfs_update()) Process entered 00000020:00000010:0.0:1789499365.647346:0:6488:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329c80. 00000004:00000020:3.0:1789499365.647349:0:7427:0:(osp_precreate.c:198:osp_statfs_update()) going to update statfs 00000020:00000010:0.0:1789499365.647354:0:6488:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000100:00000010:3.0:1789499365.647356:0:7427:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3fcdb5f80. 00000020:00000040:3.0:1789499365.647361:0:7427:0:(genops.c:1209:class_import_get()) import ffff9ab3f5de0800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000001:1.0:1789499365.647361:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647366:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1789499365.647366:0:6488:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt_out at +6s 00000100:00000001:3.0:1789499365.647367:0:7427:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1789499365.647370:0:7427:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:0.0:1789499365.647372:0:6488:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1789499365.647373:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 02000000:00000001:3.0:1789499365.647375:0:7427:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647376:0:6488:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000010:1.0:1789499365.647378:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c8700. 00000100:00000001:0.0:1789499365.647381:0:6488:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:1.0:1789499365.647382:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3f5f7d800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 02000000:00000010:3.0:1789499365.647383:0:7427:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab3ee89c700. 00000100:00000001:3.0:1789499365.647388:0:7427:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647390:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000100:00000001:0.0:1789499365.647390:0:6488:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647393:0:7427:0:(jobid.c:959:lustre_get_jobid()) Process entered 02000000:00000001:1.0:1789499365.647393:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.647397:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647398:0:7427:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1789499365.647402:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665900. 00000100:00000001:0.0:1789499365.647405:0:6488:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.647406:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.647407:0:7427:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d513da28] to pc [ptlrpcd_00_03+3] req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.647414:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1789499365.647420:0:6488:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1789499365.647424:0:6488:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000004:00000001:3.0:1789499365.647429:0:7427:0:(osp_precreate.c:256:osp_statfs_update()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647430:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1789499365.647434:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789499365.647434:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00000001:3.0:1789499365.647440:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000040:1.0:1789499365.647441:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003b4b31fb] to pc [ptlrpcd_00_00+0] req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1789499365.647441:0:6488:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c4742800 : new rpc_count 1 00000100:00000001:3.0:1789499365.647444:0:3614:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1789499365.647446:0:6488:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691290650624 : -111382418900992 : ffff9ab2c27cb800) 00000100:00000001:3.0:1789499365.647447:0:3614:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1789499365.647454:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647457:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.647458:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c27cb800 x1876424122723712/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.647462:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1789499365.647469:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1789499365.647473:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27c8e00. 00000020:00000040:1.0:1789499365.647477:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3f5f60000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000001:3.0:1789499365.647479:0:3614:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1789499365.647482:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000100:00000001:3.0:1789499365.647484:0:3614:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.647484:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:0.0:1789499365.647486:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 02000000:00000001:1.0:1789499365.647487:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.647489:0:3614:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000020:00000010:0.0:1789499365.647491:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 02000000:00000010:1.0:1789499365.647492:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665d00. 02000000:00000001:3.0:1789499365.647493:0:3614:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1789499365.647497:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.647498:0:3614:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647499:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000040:1.0:1789499365.647503:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000010:0.0:1789499365.647505:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000100:00100000:3.0:1789499365.647507:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c27c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d51d89-6692-45db-a733-1d410e949bbe:3614:1876424122723840:0@lo:400:kworker.0 00000100:00100000:0.0:1789499365.647516:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c27cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876424122723712:12345-0@lo:41:osp-pre-1-0.0 00000100:00000001:3.0:1789499365.647517:0:3614:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1789499365.647521:0:3614:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000200:0.0:1789499365.647523:0:6488:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122723712 02000000:00000001:3.0:1789499365.647524:0:3614:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.647529:0:6488:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 02000000:00000001:3.0:1789499365.647530:0:3614:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:1.0:1789499365.647532:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000020:00000001:0.0:1789499365.647534:0:6488:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000001:1.0:1789499365.647535:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499365.647536:0:3614:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c5380000. 02000000:00000001:3.0:1789499365.647540:0:3614:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.647540:0:6488:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647541:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019d0bb70] to pc [ptlrpcd_00_01+1] req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1789499365.647546:0:3614:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3d0963370. 00000020:00000001:0.0:1789499365.647546:0:6488:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1789499365.647552:0:6488:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072665230176 : -1044321440 : ffffffffc1c0eb60) 00000400:00000010:3.0:1789499365.647553:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf880. 00000100:00000001:1.0:1789499365.647554:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647557:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000001:0.0:1789499365.647557:0:6488:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000001:00000001:0.0:1789499365.647563:0:6488:0:(tgt_lastrcvd.c:2394:tgt_lookup_reply()) lustre-MDT0001: lookup reply xid 1876424122723712, found 0 last_xid 1876424122723711 00000100:00000001:1.0:1789499365.647564:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000200:3.0:1789499365.647565:0:3614:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122723840, portal 25 00000100:00000001:3.0:1789499365.647567:0:3614:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1789499365.647569:0:3614:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691290638976 : -111382418912640 : ffff9ab2c27c8a80) 00000100:00000010:1.0:1789499365.647570:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c27cbb80. 00000020:00000001:0.0:1789499365.647576:0:6488:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1789499365.647578:0:3614:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1789499365.647578:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab2c22d6000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000020:00000001:0.0:1789499365.647581:0:6488:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000100:00000001:1.0:1789499365.647584:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000020:00000001:0.0:1789499365.647586:0:6488:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 02000000:00000001:1.0:1789499365.647587:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.647591:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647592:0:3614:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000001:0.0:1789499365.647592:0:6488:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1789499365.647595:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665b00. 00000100:00000001:0.0:1789499365.647598:0:6488:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000100:00000040:3.0:1789499365.647599:0:3614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:1.0:1789499365.647600:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789499365.647604:0:6488:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000400:00000010:3.0:1789499365.647605:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf220. 00000100:00000040:1.0:1789499365.647607:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000200:3.0:1789499365.647609:0:3614:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1876424122723840, offset 0 02000000:00000010:0.0:1789499365.647611:0:6488:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 664 at ffff9ab2c377d000. 02000000:00000001:0.0:1789499365.647617:0:6488:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647619:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000400:00000200:3.0:1789499365.647620:0:3614:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:1.0:1789499365.647622:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647623:0:6488:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647629:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000039fa35a7] to pc [ptlrpcd_00_02+2] req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1789499365.647630:0:3614:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000004:00000001:0.0:1789499365.647631:0:6488:0:(mdt_handler.c:471:mdt_statfs()) Process entered 00000004:00000001:0.0:1789499365.647637:0:6488:0:(mdt_lib.c:479:mdt_check_ucred()) Process entered 00000004:00000001:0.0:1789499365.647640:0:6488:0:(mdt_lib.c:485:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647641:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647667:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1789499365.647670:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1789499365.647674:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb7480. 00000400:00000200:3.0:1789499365.647676:0:3614:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6aa9909486e00 00000020:00000040:1.0:1789499365.647677:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3fcd72000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000004:00000024:0.0:1789499365.647678:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446326272 avail 1300086784 00000100:00000001:1.0:1789499365.647682:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000100:00000001:2.0:1789499365.647684:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:3.0:1789499365.647686:0:3614:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x34eb1 [2] + 0 02000000:00000001:1.0:1789499365.647686:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000020:00000020:0.0:1789499365.647686:0:6488:0:(tgt_grant.c:198:tgt_grant_sanity_check()) lustre-MDT0001: processing self export: 0 0 0 00000100:00000001:2.0:1789499365.647687:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 02000000:00000001:1.0:1789499365.647690:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.647691:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000020:00000020:0.0:1789499365.647693:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ab2c4742800 dirty 0 pend 0 grant 0 00000400:00000010:3.0:1789499365.647695:0:3614:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec4dbcb8. 02000000:00000010:1.0:1789499365.647696:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665600. 00000100:00000040:2.0:1789499365.647698:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000020:0.0:1789499365.647701:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0001: cli e7853081-acbf-409b-bc4d-346cf5f507eb/ffff9ab2c4740000 dirty 0 pend 0 grant 2146304 00000400:00000200:3.0:1789499365.647702:0:3614:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff9ab3c54623c0 00000100:00000001:1.0:1789499365.647702:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1789499365.647709:0:3614:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000020:0.0:1789499365.647711:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0001: cli lustre-MDT0001-lwp-OST0001_UUID/ffff9ab2c3004000 dirty 0 pend 0 grant 0 00000100:00000040:1.0:1789499365.647713:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000200:3.0:1789499365.647715:0:3614:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1789499365.647716:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000020:00000020:0.0:1789499365.647719:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0001: cli lustre-MDT0001-lwp-OST0000_UUID/ffff9ab2c22d1000 dirty 0 pend 0 grant 0 00000400:00000200:3.0:1789499365.647722:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c54623c0 00000100:00000001:2.0:1789499365.647723:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1789499365.647726:0:3614:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at ffff9ab3c54623c0. 00000004:00000020:0.0:1789499365.647729:0:6488:0:(mdt_handler.c:552:mdt_statfs()) 353529 blocks: 353107 free, 317404 avail; 1024000 objects: 1023730 free; state 0 02000000:00000001:2.0:1789499365.647730:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:3.0:1789499365.647731:0:3614:0:(events.c:290:request_in_callback()) Process entered 02000000:00000001:2.0:1789499365.647733:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000200:3.0:1789499365.647734:0:3614:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 02000000:00000001:2.0:1789499365.647738:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.647740:0:3614:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c48ecc50 x1876424122723840 msgsize 224 00000100:00000001:1.0:1789499365.647740:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000001:00000001:0.0:1789499365.647741:0:6488:0:(nodemap_handler.c:1181:nodemap_get_from_exp()) Process entered 00000100:00100000:2.0:1789499365.647742:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab3fcdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724096:0@lo:41:osp-pre-0-1.0 00000100:00000001:1.0:1789499365.647745:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:0.0:1789499365.647746:0:6488:0:(nodemap_handler.c:1184:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.647748:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00100000:3.0:1789499365.647750:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 02000000:00000001:2.0:1789499365.647751:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1789499365.647753:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.647754:0:3614:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000004:00000001:0.0:1789499365.647754:0:6488:0:(mdt_handler.c:572:mdt_statfs()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647756:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000611a3e58] to pc [ptlrpcd_00_03+3] req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1789499365.647757:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00010000:00000040:0.0:1789499365.647760:0:6488:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967355, transno 0, xid 1876424122723712 02000000:00000010:2.0:1789499365.647763:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff9ab2c3d80000. 00000100:00000001:3.0:1789499365.647764:0:3614:0:(events.c:377:request_in_callback()) Process leaving 02000000:00000001:2.0:1789499365.647768:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.647768:0:6488:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000400:00000200:3.0:1789499365.647770:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf220 00000400:00000010:3.0:1789499365.647774:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf220. 00000400:00000010:2.0:1789499365.647774:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec5839f8. 00000100:00000001:1.0:1789499365.647777:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647778:0:3614:0:(events.c:35:request_out_callback()) Process entered 00010000:00000200:0.0:1789499365.647778:0:6488:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c27cb800 x1876424122723712/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/368 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1789499365.647779:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2ee0. 00000100:00000040:1.0:1789499365.647782:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000200:2.0:1789499365.647784:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1876424122724096, portal 4 00000100:00000001:2.0:1789499365.647790:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000200:3.0:1789499365.647791:0:3614:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647793:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:2.0:1789499365.647794:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632696564899712 : -111377144651904 : ffff9ab3fcdb5f80) 00000100:00000040:2.0:1789499365.647802:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1789499365.647803:0:6488:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00000010:1.0:1789499365.647805:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb7b80. 00010000:00000001:0.0:1789499365.647807:0:6488:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647808:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000020:00000040:1.0:1789499365.647810:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab2c32de000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1789499365.647813:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647816:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000100:00001000:0.0:1789499365.647816:0:6488:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3e90555e8 time=24 v=5 (1 4 4 1) 00000100:00000001:2.0:1789499365.647818:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 02000000:00000001:1.0:1789499365.647819:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000040:2.0:1789499365.647823:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 02000000:00000001:1.0:1789499365.647823:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647827:0:6488:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000400:00000010:2.0:1789499365.647829:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e22a8. 02000000:00000010:1.0:1789499365.647830:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665e00. 00000100:00000001:3.0:1789499365.647831:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1789499365.647831:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1876424122724096, offset 0 00000100:00000040:0.0:1789499365.647833:0:6488:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:1.0:1789499365.647836:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647839:0:6488:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000400:00000200:2.0:1789499365.647843:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000040:1.0:1789499365.647843:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 02000000:00000001:0.0:1789499365.647853:0:6488:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000400:00000200:2.0:1789499365.647856:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:1.0:1789499365.647857:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 02000000:00000001:0.0:1789499365.647857:0:6488:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647861:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.647863:0:6488:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000400:00000200:2.0:1789499365.647865:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 24 MB=0x6aa9909486f00 00000100:00000040:1.0:1789499365.647866:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002297a998] to pc [ptlrpcd_00_00+0] req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1789499365.647871:0:6488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000200:2.0:1789499365.647877:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 224/224 into md 0x465 [256] + 13432 00000400:00000010:0.0:1789499365.647878:0:6488:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000100:00000001:1.0:1789499365.647879:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647884:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000200:2.0:1789499365.647897:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:0.0:1789499365.647900:0:6488:0:(niobuf.c:94:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1876424122723712, offset 224 00000100:00000001:1.0:1789499365.647901:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000400:00000200:2.0:1789499365.647905:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000010:1.0:1789499365.647907:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb6300. 00000100:00000001:3.0:1789499365.647909:0:3614:0:(events.c:69:request_out_callback()) Process leaving 00000020:00000040:1.0:1789499365.647912:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab2c32de800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000400:00000200:0.0:1789499365.647912:0:6488:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:3.0:1789499365.647917:0:3614:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.647917:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000100:00000001:2.0:1789499365.647918:0:3616:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1789499365.647922:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 02000000:00000001:1.0:1789499365.647922:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:3.0:1789499365.647923:0:3614:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS new deadline estimation for cpu 0 is 4296593544 00000400:00000200:0.0:1789499365.647925:0:6488:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 02000000:00000001:1.0:1789499365.647927:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647929:0:3614:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4296592109 00000100:00000010:2.0:1789499365.647929:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50b9500. 00000100:00000040:2.0:1789499365.647933:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50b9500 x1876424122724096 msgsize 224 02000000:00000010:1.0:1789499365.647934:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665a00. 00000100:00000001:3.0:1789499365.647935:0:3614:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS new deadline estimation for cpu 1 is 4296593544 00000400:00000200:0.0:1789499365.647937:0:6488:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 368 into portal 4 MB=0x6aa9909486d80 00000100:00000001:3.0:1789499365.647941:0:3614:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4296592109 00000100:00100000:2.0:1789499365.647942:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1789499365.647943:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.647946:0:3614:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS new deadline estimation for cpu 2 is 4296593544 00000400:00000200:0.0:1789499365.647948:0:6488:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 368/368 into md 0x35ee5 [1] + 224 00000100:00000001:3.0:1789499365.647951:0:3614:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4296592109 00000100:00000040:1.0:1789499365.647951:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1789499365.647957:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:0.0:1789499365.647957:0:6488:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:3.0:1789499365.647958:0:3614:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS new deadline estimation for cpu 3 is 4296593544 00000400:00000200:2.0:1789499365.647964:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e22a8 00000400:00000200:0.0:1789499365.647968:0:6488:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000010:2.0:1789499365.647969:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e22a8. 00000100:00000001:1.0:1789499365.647969:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1789499365.647973:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.647977:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000100:00000040:1.0:1789499365.647978:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005f306b2f] to pc [ptlrpcd_00_01+1] req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.647978:0:6488:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789499365.647984:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1789499365.647986:0:6488:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.647995:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.647999:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1789499365.648003:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789499365.648008:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.648009:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1789499365.648012:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb6a00. 00000020:00000040:1.0:1789499365.648016:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3fcf04800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000001:1.0:1789499365.648020:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1789499365.648022:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:2.0:1789499365.648023:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.648024:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648027:0:3616:0:(events.c:69:request_out_callback()) Process leaving 02000000:00000010:1.0:1789499365.648028:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665700. 00000100:00000001:1.0:1789499365.648032:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648033:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.648036:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1789499365.648038:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 105642 usecs (106 jiffies) 00000100:00000001:2.0:1789499365.648044:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296591979 00000100:00000001:2.0:1789499365.648048:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:1.0:1789499365.648048:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1789499365.648053:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296591979 00000100:00000001:1.0:1789499365.648053:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648057:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648060:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296591979 00000100:00000040:1.0:1789499365.648062:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000943cb72] to pc [ptlrpcd_00_02+2] req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.648063:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648067:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296591979 00000100:00000001:3.0:1789499365.648071:0:3614:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.206.127@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4296592109 00000100:00000001:2.0:1789499365.648076:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.648077:0:3614:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.648080:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.648081:0:3614:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648081:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648082:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648084:0:3614:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648087:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.648087:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.648088:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1789499365.648089:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.648091:0:3614:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1789499365.648094:0:3614:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1789499365.648095:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1789499365.648096:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:3.0:1789499365.648097:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499365.648097:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1789499365.648100:0:3614:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1789499365.648100:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499365.648101:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1789499365.648102:0:3614:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000001:2.0:1789499365.648103:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000010:1.0:1789499365.648103:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb4e00. 00000100:00000040:3.0:1789499365.648106:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.648108:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1789499365.648109:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab2c4b19800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000001:1.0:1789499365.648116:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1789499365.648119:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.648123:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1789499365.648130:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665200. 00000100:00000001:3.0:1789499365.648135:0:3614:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1789499365.648136:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648138:0:3614:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.648140:0:6488:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 02000000:00000001:3.0:1789499365.648144:0:3614:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1789499365.648147:0:3614:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000040:1.0:1789499365.648147:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 02000000:00000001:3.0:1789499365.648151:0:3614:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648152:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1789499365.648155:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499365.648157:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c27c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876424122724352:0@lo:400:kworker.0 02000000:00000001:2.0:1789499365.648159:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1789499365.648162:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.648165:0:3614:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1789499365.648167:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.648169:0:3614:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1789499365.648172:0:3614:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499365.648173:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724608:0@lo:400:kworker.0 02000000:00000001:3.0:1789499365.648176:0:3614:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:1.0:1789499365.648179:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 02000000:00000010:3.0:1789499365.648181:0:3614:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c5381000. 00000100:00000001:2.0:1789499365.648181:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00000001:1.0:1789499365.648184:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.648185:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:0.0:1789499365.648185:0:6488:0:(events.c:165:reply_in_callback()) Process leaving 02000000:00000001:2.0:1789499365.648188:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.648190:0:3614:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.648191:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000010:3.0:1789499365.648193:0:3614:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3d0963898. 02000000:00000010:2.0:1789499365.648193:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab3c906ea00. 02000000:00000001:2.0:1789499365.648196:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1789499365.648197:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf220. 00000100:00000040:1.0:1789499365.648199:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e3c6c05c] to pc [ptlrpcd_00_03+3] req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.648199:0:6488:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000400:00000010:2.0:1789499365.648200:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec583528. 00000400:00000010:0.0:1789499365.648204:0:6488:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 00000100:00000001:0.0:1789499365.648210:0:6488:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000200:3.0:1789499365.648211:0:3614:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724352, portal 10 00000400:00000010:2.0:1789499365.648212:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e22a8. 00000100:00000001:0.0:1789499365.648213:0:6488:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1789499365.648215:0:3614:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000200:2.0:1789499365.648216:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724608, portal 4 00000100:00000001:1.0:1789499365.648217:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648218:0:3614:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691290639872 : -111382418911744 : ffff9ab2c27c8e00) 00000100:00000001:2.0:1789499365.648219:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1789499365.648220:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315733632 : -111382393817984 : ffff9ab2c3fb7480) 00000100:00000001:0.0:1789499365.648220:0:6488:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.648226:0:3614:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1789499365.648228:0:6488:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000100:00000040:1.0:1789499365.648229:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1789499365.648230:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1789499365.648234:0:6488:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:0.0:1789499365.648238:0:6488:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648240:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:3.0:1789499365.648242:0:3614:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000001:0.0:1789499365.648245:0:6488:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1789499365.648246:0:3614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:2.0:1789499365.648246:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000010:1.0:1789499365.648247:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb5880. 00000400:00000010:3.0:1789499365.648251:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf440. 00000100:00000040:2.0:1789499365.648252:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1789499365.648253:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab3e08b3000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000200:3.0:1789499365.648254:0:3614:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122724352, offset 0 00000400:00000010:2.0:1789499365.648254:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2f68. 00000100:00000040:0.0:1789499365.648254:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27cb800 x1876424122723712/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/368 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789499365.648259:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1876424122724608, offset 0 00000100:00000001:1.0:1789499365.648260:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 00000400:00000200:3.0:1789499365.648264:0:3614:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 02000000:00000001:1.0:1789499365.648265:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1789499365.648270:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.648272:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1789499365.648276:0:3614:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 02000000:00000010:1.0:1789499365.648279:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665f00. 00000100:00100000:0.0:1789499365.648281:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c27cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876424122723712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 790us (1243us total) trans 0 rc 0/0 00000400:00000200:2.0:1789499365.648282:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:1.0:1789499365.648285:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1789499365.648286:0:3614:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909487000 00000400:00000200:2.0:1789499365.648292:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 28 MB=0x6aa9909487100 00000400:00000200:3.0:1789499365.648297:0:3614:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 21056 00000100:00000040:1.0:1789499365.648297:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789499365.648301:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000400:00000200:3.0:1789499365.648305:0:3614:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1789499365.648308:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1c from 12345-0@lo of length 224/224 into md 0x28709 [8] + 6496 00000400:00000200:3.0:1789499365.648312:0:3614:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000040:0.0:1789499365.648316:0:6488:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c4742800 : new rpc_count 0 00000400:00000200:2.0:1789499365.648317:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:3.0:1789499365.648319:0:3614:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1789499365.648323:0:3614:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000001:0.0:1789499365.648323:0:6488:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1789499365.648324:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000400:00000200:2.0:1789499365.648325:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1789499365.648327:0:6488:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000001:1.0:1789499365.648329:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1789499365.648330:0:3614:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3fcdb7480. 00000100:00000001:2.0:1789499365.648330:0:3616:0:(events.c:290:request_in_callback()) Process entered 00000100:00000040:3.0:1789499365.648333:0:3614:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3fcdb7480 x1876424122724352 msgsize 224 00000100:00000200:2.0:1789499365.648333:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost 00000020:00000010:0.0:1789499365.648334:0:6488:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329c80. 00000100:00000010:2.0:1789499365.648337:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50b9c00. 00000100:00000040:1.0:1789499365.648340:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000873fed87] to pc [ptlrpcd_00_00+0] req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.648341:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000010:0.0:1789499365.648341:0:6488:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000100:00000040:2.0:1789499365.648349:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50b9c00 x1876424122724608 msgsize 224 00000020:00000010:0.0:1789499365.648349:0:6488:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418600. 00000100:00000001:3.0:1789499365.648351:0:3614:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:1.0:1789499365.648356:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1789499365.648359:0:6488:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c4742800 : new refcount 4 00000400:00000200:3.0:1789499365.648360:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf440 00000100:00100000:2.0:1789499365.648362:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1789499365.648362:0:26988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000010:3.0:1789499365.648364:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf440. 00000100:00000001:0.0:1789499365.648367:0:6488:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.648369:0:3614:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:1.0:1789499365.648370:0:26988:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:2.0:1789499365.648372:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000200:3.0:1789499365.648374:0:3614:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1789499365.648376:0:26988:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb4000. 00000400:00000200:2.0:1789499365.648378:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2f68 00000100:00000001:0.0:1789499365.648379:0:6488:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000020:00000040:1.0:1789499365.648382:0:26988:0:(genops.c:1209:class_import_get()) import ffff9ab2c4741000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000400:00000010:2.0:1789499365.648383:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2f68. 00000100:00100000:0.0:1789499365.648384:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724096 00000100:00000001:2.0:1789499365.648387:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:1.0:1789499365.648389:0:26988:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1789499365.648390:0:6488:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789499365.648391:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000200:2.0:1789499365.648393:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:1.0:1789499365.648393:0:26988:0:(sec.c:439:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:0.0:1789499365.648394:0:6488:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000040:3.0:1789499365.648396:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:1.0:1789499365.648398:0:26988:0:(sec.c:463:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.648399:0:6488:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1789499365.648405:0:26988:0:(sec_null.c:135:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9ab2c2665100. 00000100:00000001:2.0:1789499365.648407:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 02000000:00000001:0.0:1789499365.648407:0:6488:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648408:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648411:0:26988:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789499365.648413:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724096 00000100:00000040:2.0:1789499365.648414:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.648417:0:3614:0:(events.c:69:request_out_callback()) Process leaving 00000020:00000001:0.0:1789499365.648418:0:6488:0:(genops.c:792:class_conn2export()) Process entered 00000100:00000040:1.0:1789499365.648419:0:26988:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1789499365.648423:0:3614:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1789499365.648423:0:6488:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc037913 00000100:00000040:3.0:1789499365.648429:0:3614:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 11016 usecs (12 jiffies) 00000020:00000001:0.0:1789499365.648430:0:6488:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1789499365.648435:0:6488:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c352f800 refcount=5 00000100:00000001:3.0:1789499365.648436:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 0 is 4296591885 00000100:00000001:2.0:1789499365.648436:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648438:0:26988:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000020:00000001:0.0:1789499365.648441:0:6488:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691304691712 : -111382404859904 : ffff9ab2c352f800) 00000100:00000001:3.0:1789499365.648442:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648442:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1789499365.648442:0:26988:0:(jobid.c:999:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648447:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.648448:0:6488:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691304691712 : -111382404859904 : ffff9ab2c352f800) 00000100:00000001:3.0:1789499365.648449:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 1 is 4296591885 00000100:00000040:2.0:1789499365.648450:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 7296 usecs (8 jiffies) 00000100:00000040:1.0:1789499365.648451:0:26988:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009073532a] to pc [ptlrpcd_00_01+1] req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.648454:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 1, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648455:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296591881 00000100:00000001:0.0:1789499365.648455:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.648460:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 2 is 4296591885 00000100:00000001:2.0:1789499365.648461:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000020:00000010:0.0:1789499365.648461:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 00000100:00000001:3.0:1789499365.648465:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648465:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296591881 00000100:00000001:0.0:1789499365.648466:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.648471:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000020:00000010:0.0:1789499365.648473:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000100:00000001:3.0:1789499365.648476:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS new deadline estimation for cpu 3 is 4296591885 00000100:00000001:2.0:1789499365.648476:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296591881 00000020:00000010:0.0:1789499365.648481:0:6488:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418600. 00000100:00000001:3.0:1789499365.648483:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648483:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000020:00000010:0.0:1789499365.648488:0:6488:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329c80. 00000100:00000001:3.0:1789499365.648490:0:3614:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.648490:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296591881 00000100:00000001:1.0:1789499365.648493:0:26988:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.648494:0:6488:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000100:00000001:3.0:1789499365.648495:0:3614:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648495:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648500:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.648501:0:3614:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1789499365.648501:0:26988:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (1929) 00000100:00000001:2.0:1789499365.648503:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.648504:0:6488:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt_out at +6s 00000100:00000040:3.0:1789499365.648507:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.648509:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.648509:0:6488:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1789499365.648513:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.648513:0:6488:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1789499365.648517:0:6488:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648518:0:3614:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1789499365.648518:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1789499365.648520:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789499365.648521:0:3614:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648521:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1789499365.648524:0:3613:0:(client.c:1991:ptlrpc_check_set()) Process entered 02000000:00000001:3.0:1789499365.648525:0:3614:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:2.0:1789499365.648525:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789499365.648525:0:6488:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648529:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499365.648529:0:3613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 02000000:00000001:3.0:1789499365.648530:0:3614:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1789499365.648534:0:3614:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648536:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1789499365.648538:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.648538:0:6488:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:3.0:1789499365.648539:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876424122724864:0@lo:400:kworker.0 00000100:00000040:2.0:1789499365.648540:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.648545:0:3614:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1789499365.648548:0:3614:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1789499365.648551:0:3614:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.648554:0:3614:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:0.0:1789499365.648557:0:6488:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 02000000:00000010:3.0:1789499365.648559:0:3614:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c5380a00. 00000100:00000001:0.0:1789499365.648562:0:6488:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 02000000:00000001:3.0:1789499365.648564:0:3614:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648568:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000400:00000010:3.0:1789499365.648570:0:3614:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3d0963e18. 00000100:00000001:1.0:1789499365.648570:0:3613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1789499365.648571:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1789499365.648571:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00000001:1.0:1789499365.648574:0:3613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.648575:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000400:00000010:3.0:1789499365.648576:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf440. 00000100:00000040:0.0:1789499365.648578:0:6488:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c352f800 : new rpc_count 1 02000000:00000001:2.0:1789499365.648579:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000200:3.0:1789499365.648581:0:3614:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724864, portal 10 02000000:00000001:1.0:1789499365.648581:0:3613:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1789499365.648584:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.648584:0:6488:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433841408 : -111377275710208 : ffff9ab3f50b9500) 02000000:00000001:1.0:1789499365.648586:0:3613:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.648591:0:3614:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00100000:2.0:1789499365.648591:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876424122725120:0@lo:400:kworker.0 02000000:00000001:1.0:1789499365.648592:0:3613:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648594:0:3614:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315729152 : -111382393822464 : ffff9ab2c3fb6300) 00000100:00000040:0.0:1789499365.648595:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50b9500 x1876424122724096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.648599:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00100000:1.0:1789499365.648602:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c27c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876424122724224:0@lo:400:kworker.0 02000000:00000001:2.0:1789499365.648603:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000040:3.0:1789499365.648604:0:3614:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1789499365.648606:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.648610:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:1.0:1789499365.648614:0:3613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000010:2.0:1789499365.648615:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab3d32e5800. 02000000:00000001:2.0:1789499365.648620:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.648621:0:3613:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:0.0:1789499365.648623:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000400:00000010:2.0:1789499365.648624:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec583f78. 00000100:00000001:3.0:1789499365.648625:0:3614:0:(niobuf.c:69:ptl_send_buf()) Process entered 02000000:00000001:1.0:1789499365.648626:0:3613:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.648629:0:3614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1789499365.648629:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2f68. 00000020:00000010:0.0:1789499365.648629:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 02000000:00000001:1.0:1789499365.648631:0:3613:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000010:3.0:1789499365.648633:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfe58. 00000100:00000200:2.0:1789499365.648633:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122725120, portal 4 00000100:00000001:0.0:1789499365.648635:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.648636:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000200:3.0:1789499365.648637:0:3614:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122724864, offset 0 02000000:00000010:1.0:1789499365.648638:0:3613:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab3f5281000. 00000100:00000001:2.0:1789499365.648639:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315723776 : -111382393827840 : ffff9ab2c3fb4e00) 00000020:00000010:0.0:1789499365.648642:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000100:00000040:2.0:1789499365.648666:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1789499365.648667:0:3614:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1789499365.648672:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000400:00000200:3.0:1789499365.648673:0:3614:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000040:2.0:1789499365.648674:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 02000000:00000001:1.0:1789499365.648676:0:3613:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789499365.648677:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2088. 00000400:00000200:3.0:1789499365.648681:0:3614:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909487200 00000100:00000200:2.0:1789499365.648683:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1876424122725120, offset 0 00000100:00100000:0.0:1789499365.648683:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724096:12345-0@lo:41:osp-pre-0-1.0 00000400:00000010:1.0:1789499365.648685:0:3613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3fcfbb5d8. 00000400:00000200:3.0:1789499365.648688:0:3614:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 21280 00000100:00000200:0.0:1789499365.648692:0:6488:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724096 00000020:00000001:0.0:1789499365.648695:0:6488:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000400:00000200:3.0:1789499365.648696:0:3614:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1789499365.648698:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000001:0.0:1789499365.648698:0:6488:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000400:00000200:3.0:1789499365.648702:0:3614:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1789499365.648703:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000001:0.0:1789499365.648703:0:6488:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1789499365.648705:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4aa0. 00000100:00000001:3.0:1789499365.648706:0:3614:0:(events.c:290:request_in_callback()) Process entered 00000020:00000001:0.0:1789499365.648708:0:6488:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000200:3.0:1789499365.648709:0:3614:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000020:00000001:0.0:1789499365.648711:0:6488:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072665230176 : -1044321440 : ffffffffc1c0eb60) 00000100:00000200:1.0:1789499365.648712:0:3613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724224, portal 10 00000100:00000010:3.0:1789499365.648714:0:3614:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3fcdb5180. 00000400:00000200:2.0:1789499365.648715:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 28 MB=0x6aa9909487300 00000020:00000001:0.0:1789499365.648716:0:6488:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000040:3.0:1789499365.648719:0:3614:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3fcdb5180 x1876424122724864 msgsize 224 00000100:00000001:1.0:1789499365.648719:0:3613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000001:00000001:0.0:1789499365.648720:0:6488:0:(tgt_lastrcvd.c:2394:tgt_lookup_reply()) lustre-MDT0000: lookup reply xid 1876424122724096, found 0 last_xid 1876424122723967 00000100:00000001:1.0:1789499365.648723:0:3613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691290638080 : -111382418913536 : ffff9ab2c27c8700) 00000400:00000200:2.0:1789499365.648724:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1c from 12345-0@lo of length 224/224 into md 0x28709 [8] + 6720 00000020:00000001:0.0:1789499365.648725:0:6488:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:3.0:1789499365.648729:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000001:0.0:1789499365.648730:0:6488:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1789499365.648732:0:6488:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000400:00000200:2.0:1789499365.648734:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000001:0.0:1789499365.648734:0:6488:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.648736:0:3613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.648737:0:3614:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:0.0:1789499365.648739:0:6488:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000400:00000200:3.0:1789499365.648743:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfe58 00000400:00000200:2.0:1789499365.648743:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 02000000:00000001:0.0:1789499365.648743:0:6488:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000400:00000010:3.0:1789499365.648747:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfe58. 02000000:00000010:0.0:1789499365.648748:0:6488:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 664 at ffff9ab2c377ec00. 00000100:00000001:3.0:1789499365.648752:0:3614:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:2.0:1789499365.648752:0:3616:0:(events.c:290:request_in_callback()) Process entered 02000000:00000001:0.0:1789499365.648753:0:6488:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.648757:0:6488:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.648759:0:3614:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.648760:0:3613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000200:2.0:1789499365.648761:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost 00000004:00000001:0.0:1789499365.648762:0:6488:0:(mdt_handler.c:471:mdt_statfs()) Process entered 00000004:00000001:0.0:1789499365.648765:0:6488:0:(mdt_lib.c:479:mdt_check_ucred()) Process entered 00000100:00000010:2.0:1789499365.648767:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50b8a80. 00000100:00000040:1.0:1789499365.648768:0:3613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000004:00000001:0.0:1789499365.648768:0:6488:0:(mdt_lib.c:485:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.648771:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50b8a80 x1876424122725120 msgsize 224 00000100:00000001:3.0:1789499365.648775:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000400:00000010:1.0:1789499365.648776:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4c38. 00000100:00100000:2.0:1789499365.648777:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1789499365.648780:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1789499365.648780:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446182912 avail 1299943424 00000100:00000200:1.0:1789499365.648783:0:3613:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122724224, offset 0 00000100:00000001:2.0:1789499365.648787:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000020:00000020:0.0:1789499365.648792:0:6488:0:(tgt_grant.c:198:tgt_grant_sanity_check()) lustre-MDT0000: processing self export: 0 0 0 00000100:00000001:3.0:1789499365.648793:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.648796:0:3613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000020:0.0:1789499365.648798:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ab2c352f800 dirty 0 pend 0 grant 0 00000100:00000001:3.0:1789499365.648799:0:3614:0:(events.c:69:request_out_callback()) Process leaving 00000400:00000200:2.0:1789499365.648800:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2088 00000020:00000020:0.0:1789499365.648804:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli e7853081-acbf-409b-bc4d-346cf5f507eb/ffff9ab2c5524000 dirty 0 pend 0 grant 2097152 00000100:00000001:3.0:1789499365.648805:0:3614:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789499365.648805:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2088. 00000400:00000200:1.0:1789499365.648808:0:3613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000020:0.0:1789499365.648811:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli lustre-MDT0000-lwp-MDT0000_UUID/ffff9ab40093c000 dirty 0 pend 0 grant 0 00000100:00000040:3.0:1789499365.648812:0:3614:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 11208 usecs (12 jiffies) 00000100:00000001:2.0:1789499365.648812:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000020:00000020:0.0:1789499365.648816:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli lustre-MDT0000-lwp-OST0001_UUID/ffff9ab2c4d2d800 dirty 0 pend 0 grant 0 00000100:00000001:3.0:1789499365.648818:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS new deadline estimation for cpu 0 is 4296591886 00000100:00000200:2.0:1789499365.648819:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000020:0.0:1789499365.648821:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli lustre-MDT0000-lwp-OST0000_UUID/ffff9ab3c7ead800 dirty 0 pend 0 grant 0 00000020:00000020:0.0:1789499365.648825:0:6488:0:(tgt_grant.c:126:tgt_check_export_grants()) lustre-MDT0000: cli lustre-MDT0000-lwp-MDT0001_UUID/ffff9ab2c4d2f800 dirty 0 pend 0 grant 0 00000100:00000001:3.0:1789499365.648829:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000400:00000200:1.0:1789499365.648829:0:3613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909486f80 00000004:00000020:0.0:1789499365.648832:0:6488:0:(mdt_handler.c:552:mdt_statfs()) 353529 blocks: 353072 free, 317369 avail; 1024000 objects: 1023697 free; state 0 00000100:00000001:3.0:1789499365.648835:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS new deadline estimation for cpu 1 is 4296591886 00000100:00000001:3.0:1789499365.648841:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000400:00000200:1.0:1789499365.648841:0:3613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 21504 00000100:00000001:2.0:1789499365.648842:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000001:00000001:0.0:1789499365.648842:0:6488:0:(nodemap_handler.c:1181:nodemap_get_from_exp()) Process entered 00000001:00000001:0.0:1789499365.648845:0:6488:0:(nodemap_handler.c:1184:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648847:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS new deadline estimation for cpu 2 is 4296591886 00000100:00000040:2.0:1789499365.648849:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000001:0.0:1789499365.648850:0:6488:0:(mdt_handler.c:572:mdt_statfs()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.648852:0:3613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00010000:00000040:0.0:1789499365.648854:0:6488:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724096 00010000:00000001:0.0:1789499365.648859:0:6488:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000400:00000200:1.0:1789499365.648861:0:3613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00010000:00000200:0.0:1789499365.648865:0:6488:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50b9500 x1876424122724096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/368 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.648868:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648870:0:3613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000001:2.0:1789499365.648875:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000200:1.0:1789499365.648875:0:3613:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00010000:00000001:0.0:1789499365.648876:0:6488:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1789499365.648879:0:6488:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:1.0:1789499365.648882:0:3613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c3fb4a80. 00000100:00001000:0.0:1789499365.648882:0:6488:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3e90555e8 time=24 v=5 (1 4 4 1) 00000100:00000001:2.0:1789499365.648883:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.648899:0:6488:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1789499365.648900:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 9536 usecs (10 jiffies) 00000100:00000040:1.0:1789499365.648902:0:3613:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c3fb4a80 x1876424122724224 msgsize 224 00000100:00000040:0.0:1789499365.648905:0:6488:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:2.0:1789499365.648906:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4296591884 00000100:00000001:0.0:1789499365.648910:0:6488:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000100:00000001:2.0:1789499365.648912:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 0, keep current deadline 4296593544 02000000:00000001:0.0:1789499365.648916:0:6488:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000100:00000001:2.0:1789499365.648918:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4296591884 00000100:00100000:1.0:1789499365.648918:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 02000000:00000001:0.0:1789499365.648919:0:6488:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648924:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 1, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.648926:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:0.0:1789499365.648926:0:6488:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:2.0:1789499365.648927:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4296591884 00000100:00000001:3.0:1789499365.648929:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS new deadline estimation for cpu 3 is 4296591886 00000100:00000001:1.0:1789499365.648930:0:3613:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.648931:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.648931:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000040:0.0:1789499365.648934:0:6488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:3.0:1789499365.648936:0:3614:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.648936:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4296591884 00000400:00000200:1.0:1789499365.648939:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4c38 00000100:00000001:3.0:1789499365.648940:0:3614:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.648940:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 3, keep current deadline 4296593544 00000400:00000010:0.0:1789499365.648940:0:6488:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000400:00000010:1.0:1789499365.648944:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4c38. 00000100:00000001:2.0:1789499365.648945:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.648946:0:3614:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648949:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.648949:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.648950:0:3613:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:2.0:1789499365.648952:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.648953:0:3614:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000200:0.0:1789499365.648954:0:6488:0:(niobuf.c:94:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1876424122724096, offset 224 00000100:00000001:3.0:1789499365.648956:0:3614:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1789499365.648956:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1789499365.648958:0:3613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.648961:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499365.648961:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1789499365.648964:0:3614:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1789499365.648964:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000400:00000200:0.0:1789499365.648966:0:6488:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1789499365.648973:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1789499365.648976:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000001:2.0:1789499365.648977:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1789499365.648982:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1789499365.648982:0:6488:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000040:1.0:1789499365.648983:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789499365.648988:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00000001:2.0:1789499365.648993:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.648999:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649000:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789499365.649003:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.649004:0:3613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1789499365.649008:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499365.649010:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1789499365.649011:0:3613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649012:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1789499365.649018:0:3613:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 11068 usecs (12 jiffies) 00000100:00000040:2.0:1789499365.649019:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649023:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296591886 00000100:00000001:1.0:1789499365.649028:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.649032:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1789499365.649033:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296591886 00000100:00000001:2.0:1789499365.649035:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649038:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS request active for cpu 1, keep current deadline 4296593544 02000000:00000001:2.0:1789499365.649040:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:1.0:1789499365.649042:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296591886 02000000:00000001:2.0:1789499365.649043:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1789499365.649048:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649048:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:1.0:1789499365.649053:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296591886 00000100:00100000:2.0:1789499365.649054:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c27c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122723968:0@lo:400:kworker.0 00000100:00000001:1.0:1789499365.649059:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.649061:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00000001:1.0:1789499365.649064:0:3613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1789499365.649065:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1789499365.649067:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649069:0:3614:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 02000000:00000001:2.0:1789499365.649069:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000200:0.0:1789499365.649073:0:6488:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 368 into portal 4 MB=0x6aa9909486f00 02000000:00000010:2.0:1789499365.649075:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c492ca00. 00000100:00000001:1.0:1789499365.649075:0:3613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.649076:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1789499365.649079:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649082:0:3613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000400:00000010:2.0:1789499365.649084:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec583a50. 00000400:00000200:0.0:1789499365.649088:0:6488:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 368/368 into md 0x35ef5 [1] + 224 00000100:00000001:3.0:1789499365.649090:0:3614:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000040:1.0:1789499365.649091:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.649093:0:3614:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.649098:0:3614:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1789499365.649101:0:3614:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1789499365.649105:0:3614:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649110:0:3613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00100000:3.0:1789499365.649111:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876424122725376:0@lo:400:kworker.0 00000100:00000001:1.0:1789499365.649115:0:3613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649116:0:3614:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1789499365.649121:0:3614:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1789499365.649121:0:3613:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1789499365.649122:0:3614:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.649125:0:3613:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1789499365.649126:0:3614:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000001:1.0:1789499365.649130:0:3613:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499365.649131:0:3614:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c5381800. 02000000:00000001:3.0:1789499365.649135:0:3614:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1789499365.649138:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876424122724736:0@lo:400:kworker.0 00000400:00000010:3.0:1789499365.649139:0:3614:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3d0963d68. 00000100:00000001:1.0:1789499365.649145:0:3613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1789499365.649148:0:3613:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1789499365.649150:0:3613:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.649151:0:3613:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1789499365.649155:0:3613:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab3f5280000. 02000000:00000001:1.0:1789499365.649157:0:3613:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1789499365.649160:0:3613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3fcfbb6e0. 00000400:00000010:3.0:1789499365.649214:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfe58. 00000400:00000010:2.0:1789499365.649214:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2088. 00000400:00000200:0.0:1789499365.649215:0:6488:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:1.0:1789499365.649216:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4c38. 00000100:00000200:2.0:1789499365.649220:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122723968, portal 4 00000100:00000001:2.0:1789499365.649223:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000200:1.0:1789499365.649224:0:3613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724736, portal 10 00000100:00000200:3.0:1789499365.649225:0:3614:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122725376, portal 10 00000100:00000001:2.0:1789499365.649226:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691290640768 : -111382418910848 : ffff9ab2c27c9180) 00000400:00000200:0.0:1789499365.649226:0:6488:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1789499365.649230:0:3613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1789499365.649231:0:3614:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1789499365.649235:0:3614:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315720192 : -111382393831424 : ffff9ab2c3fb4000) 00000100:00000040:2.0:1789499365.649235:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649235:0:3613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315735424 : -111382393816192 : ffff9ab2c3fb7b80) 00000100:00000001:0.0:1789499365.649235:0:6488:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1789499365.649243:0:6488:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.649247:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1789499365.649249:0:3614:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.649250:0:3613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.649253:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1789499365.649257:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2220. 00000100:00000200:2.0:1789499365.649261:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1876424122723968, offset 0 00000400:00000200:2.0:1789499365.649276:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:3.0:1789499365.649277:0:3614:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1789499365.649277:0:6488:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649281:0:3613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1789499365.649285:0:3614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000200:2.0:1789499365.649287:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000010:3.0:1789499365.649290:0:3614:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfa18. 00000100:00000040:1.0:1789499365.649290:0:3613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:0.0:1789499365.649293:0:6488:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000200:3.0:1789499365.649296:0:3614:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122725376, offset 0 00000400:00000010:1.0:1789499365.649297:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a42a8. 00000400:00000200:2.0:1789499365.649298:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 24 MB=0x6aa9909486e80 00000400:00000200:3.0:1789499365.649302:0:3614:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1789499365.649305:0:6488:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000400:00000010:0.0:1789499365.649308:0:6488:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 00000400:00000200:3.0:1789499365.649309:0:3614:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:0.0:1789499365.649313:0:6488:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000200:1.0:1789499365.649314:0:3613:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122724736, offset 0 00000100:00000001:0.0:1789499365.649315:0:6488:0:(events.c:402:reply_out_callback()) Process leaving 00000400:00000200:3.0:1789499365.649318:0:3614:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909487400 00000400:00000200:2.0:1789499365.649318:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 224/224 into md 0x465 [256] + 13656 00000100:00000001:0.0:1789499365.649321:0:6488:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.649324:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000040:0.0:1789499365.649325:0:6488:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000400:00000200:1.0:1789499365.649326:0:3613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00010000:00000001:0.0:1789499365.649331:0:6488:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000400:00000200:2.0:1789499365.649334:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1789499365.649335:0:3614:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 21728 00000020:00000001:0.0:1789499365.649335:0:6488:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.649338:0:3613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000001:0.0:1789499365.649340:0:6488:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000400:00000200:3.0:1789499365.649345:0:3614:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:2.0:1789499365.649345:0:3616:0:(events.c:290:request_in_callback()) Process entered 00000100:00000040:0.0:1789499365.649346:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50b9500 x1876424122724096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/368 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789499365.649348:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000400:00000200:1.0:1789499365.649352:0:3613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909487180 00000400:00000200:3.0:1789499365.649353:0:3614:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000010:2.0:1789499365.649356:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50bb480. 00000100:00000040:2.0:1789499365.649360:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50bb480 x1876424122723968 msgsize 224 00000400:00000200:1.0:1789499365.649363:0:3613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 21952 00000100:00100000:0.0:1789499365.649371:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 746us (1436us total) trans 0 rc 0/0 00000100:00000001:3.0:1789499365.649372:0:3614:0:(events.c:290:request_in_callback()) Process entered 00000100:00100000:2.0:1789499365.649372:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000200:1.0:1789499365.649373:0:3613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:3.0:1789499365.649376:0:3614:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000001:2.0:1789499365.649378:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1789499365.649382:0:3613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000010:3.0:1789499365.649384:0:3614:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c54d4380. 00000100:00100000:0.0:1789499365.649384:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000400:00000200:2.0:1789499365.649385:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2220 00000100:00000040:3.0:1789499365.649389:0:3614:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c54d4380 x1876424122725376 msgsize 224 00000400:00000010:2.0:1789499365.649391:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2220. 00000100:00000040:0.0:1789499365.649392:0:6488:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c352f800 : new rpc_count 0 00000100:00000001:2.0:1789499365.649397:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:0.0:1789499365.649397:0:6488:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00100000:3.0:1789499365.649398:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:0.0:1789499365.649401:0:6488:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000200:2.0:1789499365.649403:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1789499365.649405:0:6488:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329c80. 00000100:00000001:3.0:1789499365.649408:0:3614:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:1.0:1789499365.649409:0:13832:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000020:00000010:0.0:1789499365.649410:0:6488:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000100:00100000:1.0:1789499365.649412:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724608 00000020:00000010:0.0:1789499365.649416:0:6488:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418600. 02000000:00000001:1.0:1789499365.649417:0:13832:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1789499365.649419:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000001:1.0:1789499365.649420:0:13832:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000020:00000040:0.0:1789499365.649422:0:6488:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c352f800 : new refcount 4 00000100:00000001:1.0:1789499365.649423:0:13832:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.649425:0:6488:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1789499365.649426:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:1.0:1789499365.649427:0:13832:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1789499365.649431:0:13832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724608 00000020:00000001:1.0:1789499365.649434:0:13832:0:(genops.c:792:class_conn2export()) Process entered 00000400:00000200:3.0:1789499365.649435:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfa18 00000100:00000001:0.0:1789499365.649435:0:6488:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1789499365.649439:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122723968 00000400:00000010:3.0:1789499365.649440:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfa18. 00000100:00000001:2.0:1789499365.649440:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649442:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1789499365.649443:0:3614:0:(events.c:35:request_out_callback()) Process entered 00000100:00000001:2.0:1789499365.649445:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.649446:0:3614:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1789499365.649448:0:13832:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffb607 02000000:00000001:0.0:1789499365.649448:0:6488:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000040:2.0:1789499365.649450:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 105642 usecs (106 jiffies) 00000100:00000001:0.0:1789499365.649451:0:6488:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000020:00000001:1.0:1789499365.649453:0:13832:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000001:0.0:1789499365.649454:0:6488:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649456:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296591980 00000020:00000040:1.0:1789499365.649457:0:13832:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab3d05bb800 refcount=5 02000000:00000001:0.0:1789499365.649460:0:6488:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649462:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000020:00000001:1.0:1789499365.649463:0:13832:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632695818336256 : -111377891215360 : ffff9ab3d05bb800) 00000100:00100000:0.0:1789499365.649465:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122723968 00000020:00000001:1.0:1789499365.649468:0:13832:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632695818336256 : -111377891215360 : ffff9ab3d05bb800) 00000100:00000001:3.0:1789499365.649469:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000001:2.0:1789499365.649469:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296591980 00000020:00000001:0.0:1789499365.649469:0:6488:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1789499365.649473:0:6488:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc037913 00000100:00000001:1.0:1789499365.649474:0:13832:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:3.0:1789499365.649475:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.649475:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000020:00000001:0.0:1789499365.649476:0:6488:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000010:1.0:1789499365.649479:0:13832:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510d1c0. 00000100:00000001:2.0:1789499365.649480:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296591980 00000020:00000040:0.0:1789499365.649480:0:6488:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c352f800 refcount=5 00000020:00000001:0.0:1789499365.649485:0:6488:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691304691712 : -111382404859904 : ffff9ab2c352f800) 00000100:00000001:2.0:1789499365.649486:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.649488:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:1.0:1789499365.649488:0:13832:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff9ab3f5dfb380) now 10 - evictor 00000020:00000001:0.0:1789499365.649489:0:6488:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691304691712 : -111382404859904 : ffff9ab2c352f800) 00000100:00000001:2.0:1789499365.649492:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296591980 00000100:00000001:3.0:1789499365.649493:0:3614:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:0.0:1789499365.649496:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.649498:0:3614:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.649500:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 00000100:00000040:3.0:1789499365.649502:0:3614:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9751 usecs (10 jiffies) 00000100:00000001:2.0:1789499365.649502:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:1.0:1789499365.649502:0:13832:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000100:00000001:0.0:1789499365.649503:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1789499365.649508:0:13832:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3f5281400. 00000100:00000001:2.0:1789499365.649509:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1789499365.649509:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000100:00000001:3.0:1789499365.649511:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4296591884 00000100:00000001:3.0:1789499365.649516:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.649516:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1789499365.649516:0:13832:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab2c4d1e280. 00000020:00000010:0.0:1789499365.649517:0:6488:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418600. 00000100:00000001:3.0:1789499365.649521:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4296591884 00000100:00000001:2.0:1789499365.649522:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000001:3.0:1789499365.649526:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4296593544 00000020:00000010:1.0:1789499365.649526:0:13832:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3f42b6c80. 00000020:00000010:0.0:1789499365.649526:0:6488:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329c80. 00000100:00000040:2.0:1789499365.649527:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.649531:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4296591884 00000100:00000001:3.0:1789499365.649534:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4296593544 00000020:00000010:0.0:1789499365.649534:0:6488:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000100:00000001:2.0:1789499365.649537:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000040:1.0:1789499365.649538:0:13832:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000001:3.0:1789499365.649540:0:3614:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4296591884 00000100:00000001:2.0:1789499365.649540:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.649541:0:6488:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt_out at +6s 00000100:00000001:1.0:1789499365.649543:0:13832:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1789499365.649545:0:3614:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4296593544 02000000:00000001:2.0:1789499365.649545:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:0.0:1789499365.649545:0:6488:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1789499365.649548:0:13832:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 02000000:00000001:2.0:1789499365.649549:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.649549:0:6488:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789499365.649550:0:3614:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1789499365.649552:0:13832:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.649553:0:6488:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649554:0:3614:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.649554:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649561:0:3614:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499365.649561:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c27cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876424122724480:0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.649562:0:6488:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649563:0:13832:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:3.0:1789499365.649564:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.649568:0:6488:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.649569:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00000001:1.0:1789499365.649569:0:13832:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:3.0:1789499365.649571:0:3614:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1789499365.649573:0:13832:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649574:0:3614:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 02000000:00000001:2.0:1789499365.649574:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:3.0:1789499365.649578:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:2.0:1789499365.649578:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.649578:0:6488:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1789499365.649582:0:6488:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:3.0:1789499365.649583:0:3614:0:(client.c:1991:ptlrpc_check_set()) Process entered 02000000:00000001:2.0:1789499365.649583:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:1.0:1789499365.649583:0:13832:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.649587:0:3614:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1789499365.649588:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c492da00. 00000100:00100000:0.0:1789499365.649588:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00000001:3.0:1789499365.649591:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.649593:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649594:0:13832:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000040:0.0:1789499365.649594:0:6488:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c352f800 : new rpc_count 1 00000400:00000010:2.0:1789499365.649597:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec583738. 00000100:00000001:0.0:1789499365.649598:0:6488:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433849472 : -111377275702144 : ffff9ab3f50bb480) 00000100:00100000:1.0:1789499365.649599:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122725120 02000000:00000001:1.0:1789499365.649602:0:13832:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000400:00000010:2.0:1789499365.649604:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2220. 00000100:00000001:1.0:1789499365.649605:0:13832:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000040:0.0:1789499365.649606:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50bb480 x1876424122723968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649608:0:13832:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649610:0:34657:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000200:2.0:1789499365.649610:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724480, portal 10 02000000:00000001:1.0:1789499365.649614:0:13832:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499365.649615:0:34657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122723840 00000100:00000001:2.0:1789499365.649615:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1789499365.649619:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691290651520 : -111382418900096 : ffff9ab2c27cbb80) 00000100:00100000:1.0:1789499365.649619:0:13832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122725120 02000000:00000001:3.0:1789499365.649620:0:34657:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000020:00000001:1.0:1789499365.649624:0:13832:0:(genops.c:792:class_conn2export()) Process entered 00000100:00000001:3.0:1789499365.649625:0:34657:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.649626:0:6488:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.649628:0:34657:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.649630:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1789499365.649630:0:6488:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 00000020:00000040:1.0:1789499365.649632:0:13832:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0375d9 02000000:00000001:3.0:1789499365.649633:0:34657:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.649636:0:13832:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00100000:3.0:1789499365.649638:0:34657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122723840 00000020:00000040:1.0:1789499365.649640:0:13832:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c4741800 refcount=5 00000100:00000001:0.0:1789499365.649641:0:6488:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000001:3.0:1789499365.649642:0:34657:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1789499365.649661:0:34657:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc03750e 00000020:00000001:3.0:1789499365.649663:0:34657:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1789499365.649666:0:34657:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab3ffb0c000 refcount=24 00000020:00000001:1.0:1789499365.649666:0:13832:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691323639808 : -111382385911808 : ffff9ab2c4741800) 00000020:00000010:0.0:1789499365.649667:0:6488:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103fc0. 00000020:00000001:3.0:1789499365.649670:0:34657:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632696612438016 : -111377097113600 : ffff9ab3ffb0c000) 00000020:00000001:1.0:1789499365.649672:0:13832:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691323639808 : -111382385911808 : ffff9ab2c4741800) 00000020:00000001:3.0:1789499365.649675:0:34657:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632696612438016 : -111377097113600 : ffff9ab3ffb0c000) 00000100:00000001:2.0:1789499365.649678:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:1.0:1789499365.649679:0:13832:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00100000:0.0:1789499365.649679:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122723968:12345-0@lo:400:kworker.0 00000100:00000001:3.0:1789499365.649680:0:34657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:2.0:1789499365.649684:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000010:1.0:1789499365.649685:0:13832:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510dc80. 00000100:00000200:0.0:1789499365.649688:0:6488:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122723968 00000400:00000010:2.0:1789499365.649689:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2c38. 00000020:00000010:3.0:1789499365.649690:0:34657:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000020:00000001:0.0:1789499365.649692:0:6488:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000010:1.0:1789499365.649693:0:13832:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c6093a40. 00000100:00000001:3.0:1789499365.649694:0:34657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000200:2.0:1789499365.649694:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1876424122724480, offset 0 00000020:00000001:0.0:1789499365.649695:0:6488:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1789499365.649699:0:6488:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.649700:0:34657:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00000001:1.0:1789499365.649702:0:13832:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000001:0.0:1789499365.649703:0:6488:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000400:00000200:2.0:1789499365.649704:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000010:3.0:1789499365.649707:0:34657:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5380800. 00000020:00000010:1.0:1789499365.649707:0:13832:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c510dc80. 00000020:00000001:0.0:1789499365.649707:0:6488:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000400:00000200:2.0:1789499365.649714:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000001:0.0:1789499365.649714:0:6488:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000010:3.0:1789499365.649715:0:34657:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fef80. 00000001:00000001:0.0:1789499365.649718:0:6488:0:(tgt_lastrcvd.c:2394:tgt_lookup_reply()) lustre-MDT0000: lookup reply xid 1876424122723968, found 0 last_xid 1876424122723967 00000020:00000010:3.0:1789499365.649720:0:34657:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9e10. 00000020:00000001:0.0:1789499365.649721:0:6488:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1789499365.649723:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6aa9909487080 00000020:00000001:0.0:1789499365.649724:0:6488:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1789499365.649726:0:6488:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000040:3.0:1789499365.649728:0:34657:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000001:0.0:1789499365.649729:0:6488:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649732:0:34657:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000400:00000200:2.0:1789499365.649733:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x289 [64] + 22176 00000100:00000001:3.0:1789499365.649734:0:34657:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000020:00000001:0.0:1789499365.649734:0:6488:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1789499365.649738:0:34657:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.649738:0:6488:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1789499365.649741:0:6488:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000001:3.0:1789499365.649745:0:34657:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.649746:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000010:0.0:1789499365.649746:0:6488:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c377cc00. 02000000:00000001:0.0:1789499365.649751:0:6488:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649753:0:34657:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1789499365.649755:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1789499365.649755:0:6488:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.649758:0:6488:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649759:0:3616:0:(events.c:290:request_in_callback()) Process entered 00010000:00000040:0.0:1789499365.649760:0:6488:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122723968 00000100:00000001:3.0:1789499365.649762:0:34657:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000200:2.0:1789499365.649762:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00010000:00000001:0.0:1789499365.649763:0:6488:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:3.0:1789499365.649766:0:34657:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000010:2.0:1789499365.649768:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50bad80. 00010000:00000200:0.0:1789499365.649769:0:6488:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50bb480 x1876424122723968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.649772:0:34657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00000040:2.0:1789499365.649772:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50bad80 x1876424122724480 msgsize 224 00000100:00000040:3.0:1789499365.649776:0:34657:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab3ffb0c000 : new rpc_count 1 00000100:00000001:3.0:1789499365.649780:0:34657:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691325389904 : -111382384161712 : ffff9ab2c48ecc50) 00000100:00100000:2.0:1789499365.649781:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1789499365.649787:0:34657:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c48ecc50 x1876424122723840/t0(0) o400->a7d51d89-6692-45db-a733-1d410e949bbe@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1789499365.649788:0:6488:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00000001:2.0:1789499365.649791:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00010000:00000001:0.0:1789499365.649791:0:6488:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.649796:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2c38 00000100:00001000:0.0:1789499365.649796:0:6488:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3e90555e8 time=24 v=5 (1 4 4 1) 00000400:00000010:2.0:1789499365.649800:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2c38. 00000100:00000001:3.0:1789499365.649801:0:34657:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:0.0:1789499365.649802:0:6488:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000001:2.0:1789499365.649804:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000020:00000010:3.0:1789499365.649805:0:34657:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00000040:0.0:1789499365.649805:0:6488:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:3.0:1789499365.649808:0:34657:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.649809:0:6488:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000020:00000010:3.0:1789499365.649811:0:34657:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00000200:2.0:1789499365.649811:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:0.0:1789499365.649813:0:6488:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000100:00100000:3.0:1789499365.649817:0:34657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c48ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d51d89-6692-45db-a733-1d410e949bbe+24:3614:x1876424122723840:12345-0@lo:400:kworker.0 00000100:00000001:2.0:1789499365.649818:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 02000000:00000001:0.0:1789499365.649821:0:6488:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.649822:0:34657:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122723840 00000100:00000040:2.0:1789499365.649823:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.649825:0:6488:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000001:3.0:1789499365.649826:0:34657:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1789499365.649830:0:34657:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000040:0.0:1789499365.649831:0:6488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000001:3.0:1789499365.649833:0:34657:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649833:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1789499365.649835:0:6488:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000020:00000001:3.0:1789499365.649837:0:34657:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000001:2.0:1789499365.649837:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000200:0.0:1789499365.649838:0:6488:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424122723968, offset 224 00000100:00000001:2.0:1789499365.649842:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1789499365.649843:0:6488:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000040:2.0:1789499365.649849:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 10825 usecs (11 jiffies) 00000400:00000200:0.0:1789499365.649853:0:6488:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1789499365.649855:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS new deadline estimation for cpu 0 is 4296591886 00000400:00000200:0.0:1789499365.649859:0:6488:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6aa9909486e80 00000100:00000001:2.0:1789499365.649860:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS request active for cpu 0, keep current deadline 4296593544 00000400:00000200:0.0:1789499365.649865:0:6488:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0x35f2d [1] + 224 00000100:00000001:2.0:1789499365.649866:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS new deadline estimation for cpu 1 is 4296591886 00000400:00000200:0.0:1789499365.649870:0:6488:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:2.0:1789499365.649871:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS request active for cpu 1, keep current deadline 4296593544 00000400:00000200:0.0:1789499365.649875:0:6488:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1789499365.649877:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS new deadline estimation for cpu 2 is 4296591886 00000100:00000001:0.0:1789499365.649879:0:6488:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.649883:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000200:0.0:1789499365.649884:0:6488:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:1.0:1789499365.649895:0:13832:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3f5280c00. 00000100:00000001:2.0:1789499365.649897:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS new deadline estimation for cpu 3 is 4296591886 00000020:00000010:1.0:1789499365.649903:0:13832:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab2c4d1e980. 00000100:00000001:2.0:1789499365.649904:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: PM QoS request active for cpu 3, keep current deadline 4296593544 00000020:00000001:3.0:1789499365.649910:0:34657:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072663275712 : -1046275904 : ffffffffc1a318c0) 00000020:00000010:1.0:1789499365.649910:0:13832:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3f42b6d48. 00000100:00000001:2.0:1789499365.649911:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000020:00000001:3.0:1789499365.649915:0:34657:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1789499365.649917:0:34657:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.649917:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649919:0:13832:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000040:0.0:1789499365.649920:0:6488:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649922:0:13832:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1789499365.649926:0:13832:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.649928:0:34657:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000100:00000001:2.0:1789499365.649928:0:3616:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000020:00000001:3.0:1789499365.649931:0:34657:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000001:1.0:1789499365.649932:0:13832:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000001:3.0:1789499365.649935:0:34657:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.649935:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.649936:0:13832:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000020:00000001:3.0:1789499365.649939:0:34657:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499365.649939:0:6488:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1789499365.649940:0:13832:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.649942:0:34657:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789499365.649945:0:34657:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789499365.649949:0:34657:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3d04f1000. 00000100:00000001:2.0:1789499365.649949:0:3616:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000400:00000200:0.0:1789499365.649949:0:6488:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000100:00000001:2.0:1789499365.649951:0:3616:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649952:0:13832:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000400:00000010:0.0:1789499365.649954:0:6488:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 02000000:00000001:3.0:1789499365.649955:0:34657:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.649955:0:3616:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1789499365.649958:0:3616:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.649959:0:34657:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649961:0:13832:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000020:00000001:3.0:1789499365.649962:0:34657:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.649962:0:3616:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.649962:0:6488:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1789499365.649965:0:13832:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:0.0:1789499365.649965:0:6488:0:(events.c:402:reply_out_callback()) Process leaving 00010000:00000040:3.0:1789499365.649967:0:34657:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122723840 00000100:00100000:2.0:1789499365.649969:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724992:0@lo:400:kworker.0 00010000:00000001:3.0:1789499365.649970:0:34657:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:0.0:1789499365.649971:0:6488:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.649975:0:3616:0:(niobuf.c:866:ptl_send_rpc()) Process entered 00000100:00100000:1.0:1789499365.649975:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00010000:00000200:3.0:1789499365.649976:0:34657:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c48ecc50 x1876424122723840/t0(0) o400->a7d51d89-6692-45db-a733-1d410e949bbe@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1789499365.649978:0:6488:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 02000000:00000001:2.0:1789499365.649980:0:3616:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000100:00000040:1.0:1789499365.649980:0:13832:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab3d05bb800 : new rpc_count 1 00010000:00000001:0.0:1789499365.649983:0:6488:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 02000000:00000001:2.0:1789499365.649984:0:3616:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.649985:0:13832:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433843200 : -111377275708416 : ffff9ab3f50b9c00) 00000020:00000001:0.0:1789499365.649986:0:6488:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.649988:0:3616:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1789499365.649994:0:3616:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab2c26c5c00. 00000100:00000040:1.0:1789499365.649995:0:13832:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50b9c00 x1876424122724608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789499365.649996:0:34657:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 02000000:00000001:2.0:1789499365.649997:0:3616:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1789499365.649999:0:34657:0:(ldlm_lib.c:3364:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789499365.650002:0:3616:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3ec5835d8. 00000100:00001000:3.0:1789499365.650003:0:34657:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcd985e8 time=77 v=5 (1 0 0 0) 00000400:00000010:2.0:1789499365.650007:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2c38. 00000100:00000001:1.0:1789499365.650012:0:13832:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000200:2.0:1789499365.650013:0:3616:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122724992, portal 4 00000100:00000001:2.0:1789499365.650016:0:3616:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000020:00000010:1.0:1789499365.650017:0:13832:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510dc80. 00000100:00000001:2.0:1789499365.650018:0:3616:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315730944 : -111382393820672 : ffff9ab2c3fb6a00) 00000100:00000001:1.0:1789499365.650022:0:13832:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1789499365.650026:0:13832:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c510dc80. 00000100:00000040:2.0:1789499365.650027:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789499365.650035:0:13832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724608:12345-0@lo:400:kworker.0 00000100:00000001:2.0:1789499365.650038:0:3616:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789499365.650042:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000001:0.0:1789499365.650043:0:6488:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000400:00000010:2.0:1789499365.650046:0:3616:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2a18. 00000100:00000040:0.0:1789499365.650048:0:6488:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50bb480 x1876424122723968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789499365.650050:0:3616:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1876424122724992, offset 0 00000400:00000200:2.0:1789499365.650062:0:3616:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000200:1.0:1789499365.650068:0:13832:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724608 00000100:00100000:0.0:1789499365.650069:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122723968:12345-0@lo:400:kworker.0 Request processed in 440us (705us total) trans 0 rc 0/0 00000020:00000001:1.0:1789499365.650073:0:13832:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000400:00000200:2.0:1789499365.650076:0:3616:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000001:1.0:1789499365.650078:0:13832:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00100000:0.0:1789499365.650081:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000020:00000001:1.0:1789499365.650082:0:13832:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.650086:0:3616:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 28 MB=0x6aa9909487280 00000100:00000040:0.0:1789499365.650086:0:6488:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c352f800 : new rpc_count 0 00000020:00000001:1.0:1789499365.650087:0:13832:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000001:0.0:1789499365.650090:0:6488:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000020:00000001:1.0:1789499365.650091:0:13832:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000400:00000200:2.0:1789499365.650096:0:3616:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1c from 12345-0@lo of length 224/224 into md 0x28709 [8] + 6944 00000020:00000001:1.0:1789499365.650098:0:13832:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000001:0.0:1789499365.650098:0:6488:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000001:1.0:1789499365.650103:0:13832:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1789499365.650104:0:3616:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000010:0.0:1789499365.650105:0:6488:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329c80. 00000020:00000001:1.0:1789499365.650108:0:13832:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000010:0.0:1789499365.650111:0:6488:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000400:00000200:2.0:1789499365.650112:0:3616:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000020:00000001:1.0:1789499365.650117:0:13832:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000010:0.0:1789499365.650118:0:6488:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418600. 00000100:00000001:2.0:1789499365.650119:0:3616:0:(events.c:290:request_in_callback()) Process entered 00000020:00000001:1.0:1789499365.650120:0:13832:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1789499365.650123:0:6488:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c352f800 : new refcount 4 00000020:00000001:1.0:1789499365.650124:0:13832:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000200:2.0:1789499365.650129:0:3616:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost 00000100:00000001:1.0:1789499365.650129:0:13832:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000100:00000001:0.0:1789499365.650130:0:6488:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:1.0:1789499365.650133:0:13832:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000010:2.0:1789499365.650136:0:3616:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab3f50bb800. 02000000:00000010:1.0:1789499365.650139:0:13832:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3f865bc00. 00000100:00000040:2.0:1789499365.650141:0:3616:0:(events.c:341:request_in_callback()) incoming req@ffff9ab3f50bb800 x1876424122724992 msgsize 224 02000000:00000001:1.0:1789499365.650144:0:13832:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.650150:0:13832:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499365.650151:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:3.0:1789499365.650155:0:34657:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000020:00000001:1.0:1789499365.650155:0:13832:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.650160:0:34657:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00010000:00000040:1.0:1789499365.650160:0:13832:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967320, transno 0, xid 1876424122724608 00000100:00000001:2.0:1789499365.650162:0:3616:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.650164:0:34657:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00010000:00000001:1.0:1789499365.650165:0:13832:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000400:00000200:2.0:1789499365.650168:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2a18 02000000:00000001:3.0:1789499365.650169:0:34657:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1789499365.650172:0:34657:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789499365.650172:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2a18. 00010000:00000200:1.0:1789499365.650173:0:13832:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50b9c00 x1876424122724608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.650174:0:8416:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:3.0:1789499365.650175:0:34657:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:2.0:1789499365.650175:0:3616:0:(events.c:35:request_out_callback()) Process entered 00000100:00100000:0.0:1789499365.650178:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724352 00000100:00000040:3.0:1789499365.650181:0:34657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000200:2.0:1789499365.650182:0:3616:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:0.0:1789499365.650183:0:8416:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000400:00000010:3.0:1789499365.650187:0:34657:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfa18. 00000100:00000001:0.0:1789499365.650187:0:8416:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.650191:0:8416:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.650193:0:34657:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1876424122723840, offset 224 02000000:00000001:0.0:1789499365.650198:0:8416:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1789499365.650200:0:13832:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000400:00000200:3.0:1789499365.650201:0:34657:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1789499365.650204:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00100000:0.0:1789499365.650205:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724352 00010000:00000001:1.0:1789499365.650206:0:13832:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.650208:0:8416:0:(genops.c:792:class_conn2export()) Process entered 00000100:00000040:2.0:1789499365.650209:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1789499365.650211:0:8416:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0376ff 00000400:00000200:3.0:1789499365.650212:0:34657:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00001000:1.0:1789499365.650212:0:13832:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3ee9489e8 time=12 v=5 (1 1 1 1) 00000020:00000001:0.0:1789499365.650215:0:8416:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1789499365.650220:0:8416:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab3c7ead800 refcount=5 00000100:00000001:1.0:1789499365.650222:0:13832:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000400:00000200:3.0:1789499365.650225:0:34657:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6aa9909486e00 00000020:00000001:0.0:1789499365.650225:0:8416:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632695676721152 : -111378032830464 : ffff9ab3c7ead800) 00000100:00000001:2.0:1789499365.650230:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.650230:0:13832:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 67 to 0@lo 00000020:00000001:0.0:1789499365.650231:0:8416:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632695676721152 : -111378032830464 : ffff9ab3c7ead800) 00000400:00000200:3.0:1789499365.650236:0:34657:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0x35eed [1] + 224 00000100:00000001:2.0:1789499365.650237:0:3616:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1789499365.650238:0:13832:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000100:00000001:0.0:1789499365.650238:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:2.0:1789499365.650241:0:3616:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.650242:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103fc0. 00000400:00000200:3.0:1789499365.650245:0:34657:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000001:1.0:1789499365.650245:0:13832:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000100:00000040:2.0:1789499365.650247:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 10155 usecs (11 jiffies) 02000000:00000001:1.0:1789499365.650249:0:13832:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1789499365.650249:0:8416:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00000100:00000001:2.0:1789499365.650251:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 0 is 4296591886 00000400:00000200:3.0:1789499365.650252:0:34657:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1789499365.650255:0:8416:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000100:00000001:2.0:1789499365.650257:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:1.0:1789499365.650257:0:13832:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:3.0:1789499365.650258:0:34657:0:(events.c:80:reply_in_callback()) Process entered 00000020:00000010:0.0:1789499365.650258:0:8416:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec418600. 00000100:00000001:2.0:1789499365.650262:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 1 is 4296591886 00000020:00000010:0.0:1789499365.650263:0:8416:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329c80. 00000100:00000200:3.0:1789499365.650265:0:34657:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.650266:0:13832:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:2.0:1789499365.650268:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000020:00000010:0.0:1789499365.650269:0:8416:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235708. 00000100:00000001:2.0:1789499365.650273:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 2 is 4296591886 00000400:00000010:1.0:1789499365.650274:0:13832:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4000. 00000100:00000040:0.0:1789499365.650276:0:8416:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +45s 00000100:00000001:2.0:1789499365.650277:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:0.0:1789499365.650280:0:8416:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000200:1.0:1789499365.650281:0:13832:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424122724608, offset 224 00000100:00000001:2.0:1789499365.650282:0:3616:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS new deadline estimation for cpu 3 is 4296591886 00000100:00000001:0.0:1789499365.650282:0:8416:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1789499365.650286:0:8416:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.650287:0:3616:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:2.0:1789499365.650292:0:3616:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.650293:0:8416:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:2.0:1789499365.650295:0:3616:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650297:0:8416:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000040:3.0:1789499365.650301:0:34657:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1789499365.650301:0:13832:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:0.0:1789499365.650302:0:8416:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1789499365.650308:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1789499365.650310:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000100:00000001:0.0:1789499365.650312:0:8416:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000400:00000010:2.0:1789499365.650314:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec5839f8. 00000400:00000200:1.0:1789499365.650315:0:13832:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:3.0:1789499365.650318:0:34657:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1789499365.650320:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2ee0 00000100:00000001:0.0:1789499365.650322:0:8416:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000400:00000200:1.0:1789499365.650327:0:13832:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6aa9909487100 00000400:00000010:2.0:1789499365.650329:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2ee0. 00000100:00100000:0.0:1789499365.650330:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724864 02000000:00000001:0.0:1789499365.650334:0:8416:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1789499365.650336:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:0.0:1789499365.650336:0:8416:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.650337:0:8416:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.650341:0:13832:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0x35f05 [1] + 224 02000000:00000001:0.0:1789499365.650342:0:8416:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1789499365.650343:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.650347:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724864 00000020:00000001:0.0:1789499365.650351:0:8416:0:(genops.c:792:class_conn2export()) Process entered 00000400:00000200:3.0:1789499365.650353:0:34657:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfa18 00000020:00000040:0.0:1789499365.650354:0:8416:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffb6fc 00000400:00000200:1.0:1789499365.650355:0:13832:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:3.0:1789499365.650356:0:34657:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfa18. 00000100:00000200:2.0:1789499365.650359:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.650361:0:34657:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789499365.650364:0:34657:0:(events.c:402:reply_out_callback()) Process leaving 00000400:00000200:1.0:1789499365.650365:0:13832:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1789499365.650368:0:34657:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.650368:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499365.650371:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1789499365.650372:0:34657:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:1.0:1789499365.650372:0:13832:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.650373:0:3616:0:(client.c:1593:after_reply()) Process entered 00010000:00000001:3.0:1789499365.650376:0:34657:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 02000000:00000001:2.0:1789499365.650377:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000020:00000001:3.0:1789499365.650378:0:34657:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.650378:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000020:00000001:3.0:1789499365.650381:0:34657:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000001:2.0:1789499365.650381:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:1.0:1789499365.650382:0:13832:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1789499365.650384:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.650386:0:34657:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c48ecc50 x1876424122723840/t0(0) o400->a7d51d89-6692-45db-a733-1d410e949bbe@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00001000:2.0:1789499365.650390:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3f5de0c60 time=24 v=5 (5 5 5 5) 00000100:00001000:2.0:1789499365.650396:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f5de0c18 time=66 v=5 (1 0 0 0) 00000100:00000001:2.0:1789499365.650400:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499365.650403:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789499365.650407:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1789499365.650409:0:3616:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499365.650413:0:34657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c48ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d51d89-6692-45db-a733-1d410e949bbe+24:3614:x1876424122723840:12345-0@lo:400:kworker.0 Request processed in 610us (2671us total) trans 0 rc 0/0 00000100:00000001:2.0:1789499365.650413:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1789499365.650416:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 8589934603 00000100:00000040:1.0:1789499365.650416:0:13832:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.650420:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00100000:3.0:1789499365.650422:0:34657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00000001:2.0:1789499365.650422:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.650426:0:34657:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab3ffb0c000 : new rpc_count 0 00000100:00000040:2.0:1789499365.650427:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.650430:0:34657:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1789499365.650433:0:34657:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1789499365.650436:0:34657:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fef80. 00000020:00000010:3.0:1789499365.650440:0:34657:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9e10. 00000100:00000001:2.0:1789499365.650444:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789499365.650445:0:34657:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5380800. 00000100:00000001:1.0:1789499365.650445:0:13832:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499365.650446:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789499365.650449:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000020:00000040:3.0:1789499365.650450:0:34657:0:(genops.c:879:class_export_put()) PUTting export ffff9ab3ffb0c000 : new refcount 23 00000004:00000001:2.0:1789499365.650452:0:3616:0:(osp_precreate.c:128:osp_statfs_interpret()) Process entered 00000400:00000200:1.0:1789499365.650453:0:13832:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4000 02000000:00000001:3.0:1789499365.650454:0:34657:0:(sec.c:2664:sptlrpc_svc_free_rs()) Process entered 00000004:00000040:2.0:1789499365.650455:0:3616:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=353072 avail=317369 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023697 state=0: rc = 0 02000000:00000010:3.0:1789499365.650459:0:34657:0:(sec_null.c:327:null_free_rs()) kvfree 'rs': 520 at ffff9ab3d04f1000. 00000400:00000010:1.0:1789499365.650459:0:13832:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4000. 00000020:00000001:0.0:1789499365.650460:0:8416:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000004:00000020:2.0:1789499365.650464:0:3616:0:(osp_precreate.c:160:osp_statfs_interpret()) lustre-MDT0000-osp-MDT0001 (ffff9ab3f5de1800): 353529 blocks, 353072 free, 317369 avail, 4096 bsize, 1 reserved mb low, 3 reserved mb high, 32 reserved ino low, 65 reserved ino high, 1024000 files, 1023697 free files 0x0 00000020:00000040:0.0:1789499365.650465:0:8416:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c3004000 refcount=5 00000100:00000001:1.0:1789499365.650466:0:13832:0:(events.c:390:reply_out_callback()) Process entered 02000000:00000001:3.0:1789499365.650467:0:34657:0:(sec.c:2677:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1789499365.650471:0:13832:0:(events.c:402:reply_out_callback()) Process leaving 00000020:00000001:0.0:1789499365.650471:0:8416:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691299270656 : -111382410280960 : ffff9ab2c3004000) 00000100:00000001:3.0:1789499365.650472:0:34657:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000004:00000001:2.0:1789499365.650472:0:3616:0:(osp_precreate.c:162:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.650475:0:8416:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691299270656 : -111382410280960 : ffff9ab2c3004000) 00000100:00000001:1.0:1789499365.650477:0:13832:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.650479:0:34657:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000100:00000001:0.0:1789499365.650482:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000400:00000010:3.0:1789499365.650485:0:34657:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3d0963058. 00000100:00000040:2.0:1789499365.650486:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.650486:0:13832:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000020:00000010:0.0:1789499365.650487:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103f80. 00000400:00000010:3.0:1789499365.650491:0:34657:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff9ab3f5381900. 00000020:00000040:0.0:1789499365.650493:0:8416:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff9ab3ed933380) now 12 - evictor 00010000:00000001:1.0:1789499365.650494:0:13832:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:1.0:1789499365.650498:0:13832:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650499:0:8416:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000001:1.0:1789499365.650504:0:13832:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000020:00000010:0.0:1789499365.650505:0:8416:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec419000. 00000100:00100000:2.0:1789499365.650506:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab3fcdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724096:0@lo:41:osp-pre-0-1.0 00000100:00000001:3.0:1789499365.650508:0:20957:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000040:1.0:1789499365.650511:0:13832:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50b9c00 x1876424122724608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1789499365.650512:0:8416:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329300. 00000100:00000001:2.0:1789499365.650514:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.650517:0:8416:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d0235a28. 00000100:00000001:2.0:1789499365.650520:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00100000:3.0:1789499365.650522:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724224 00000100:00000001:0.0:1789499365.650524:0:8416:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 02000000:00000001:3.0:1789499365.650527:0:20957:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1789499365.650527:0:8416:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000040:2.0:1789499365.650528:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab3fcdb5f80 x1876424122724096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.650531:0:20957:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.650531:0:8416:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.650535:0:20957:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650537:0:8416:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 02000000:00000001:3.0:1789499365.650540:0:20957:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650541:0:8416:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00100000:1.0:1789499365.650542:0:13832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724608:12345-0@lo:400:kworker.0 Request processed in 524us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789499365.650543:0:20957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724224 00000100:00000001:2.0:1789499365.650543:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00000001:0.0:1789499365.650544:0:8416:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.650547:0:20957:0:(genops.c:792:class_conn2export()) Process entered 02000000:00000001:2.0:1789499365.650547:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000020:00000040:3.0:1789499365.650550:0:20957:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0376f8 02000000:00000010:2.0:1789499365.650551:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff9ab2c3d80000. 00000020:00000001:3.0:1789499365.650553:0:20957:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000001:0.0:1789499365.650554:0:8416:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:2.0:1789499365.650555:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000040:3.0:1789499365.650556:0:20957:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c4d2f800 refcount=5 00000020:00000001:2.0:1789499365.650559:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000100:00100000:1.0:1789499365.650559:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000020:00000001:3.0:1789499365.650561:0:20957:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691329857536 : -111382379694080 : ffff9ab2c4d2f800) 00000020:00000040:2.0:1789499365.650563:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab3f5de0800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000001:0.0:1789499365.650565:0:8416:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000020:00000001:3.0:1789499365.650566:0:20957:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691329857536 : -111382379694080 : ffff9ab2c4d2f800) 00000020:00000001:2.0:1789499365.650566:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 00000100:00000040:1.0:1789499365.650566:0:13832:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab3d05bb800 : new rpc_count 0 00000100:00100000:0.0:1789499365.650568:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122725376 02000000:00000010:2.0:1789499365.650570:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab3ee89c700. 02000000:00000001:0.0:1789499365.650571:0:8416:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789499365.650572:0:20957:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:1.0:1789499365.650573:0:13832:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1789499365.650574:0:8416:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 02000000:00000001:2.0:1789499365.650575:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 00000020:00000010:3.0:1789499365.650577:0:20957:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00000001:0.0:1789499365.650577:0:8416:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.650578:0:13832:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 02000000:00000001:2.0:1789499365.650579:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000001:3.0:1789499365.650581:0:20957:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000010:2.0:1789499365.650583:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab3fcdb5f80. 00000020:00000010:3.0:1789499365.650584:0:20957:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000020:00000010:1.0:1789499365.650584:0:13832:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab2c4d1e280. 02000000:00000001:0.0:1789499365.650584:0:8416:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.650587:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00100000:0.0:1789499365.650590:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122725376 00000100:00000001:2.0:1789499365.650591:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:3.0:1789499365.650592:0:20957:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5380800. 00000020:00000001:0.0:1789499365.650592:0:8416:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000010:1.0:1789499365.650593:0:13832:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3f42b6c80. 00000020:00000010:3.0:1789499365.650596:0:20957:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fef80. 00000100:00000001:2.0:1789499365.650596:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1789499365.650596:0:8416:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc037714 00000020:00000010:1.0:1789499365.650599:0:13832:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3f5281400. 00000020:00000001:0.0:1789499365.650600:0:8416:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000001:2.0:1789499365.650601:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:3.0:1789499365.650602:0:20957:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9e10. 00000100:00000001:2.0:1789499365.650603:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1789499365.650606:0:20957:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000400:00000001:2.0:1789499365.650606:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00000001:3.0:1789499365.650609:0:20957:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000400:00000001:2.0:1789499365.650609:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000020:00000040:0.0:1789499365.650610:0:8416:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab40093c000 refcount=5 00000100:00000001:3.0:1789499365.650613:0:20957:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000400:00000010:2.0:1789499365.650613:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec583a50. 00000020:00000040:1.0:1789499365.650613:0:13832:0:(genops.c:879:class_export_put()) PUTting export ffff9ab3d05bb800 : new refcount 4 00000020:00000001:0.0:1789499365.650613:0:8416:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632696627314688 : -111377082236928 : ffff9ab40093c000) 00000100:00000001:1.0:1789499365.650619:0:13832:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1789499365.650620:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2088 00000020:00000001:0.0:1789499365.650620:0:8416:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632696627314688 : -111377082236928 : ffff9ab40093c000) 00000100:00000001:3.0:1789499365.650621:0:20957:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:3.0:1789499365.650624:0:20957:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000400:00000010:2.0:1789499365.650625:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2088. 00000100:00000001:0.0:1789499365.650626:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.650627:0:20957:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.650629:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000020:00000010:0.0:1789499365.650630:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103b80. 00000100:00000001:3.0:1789499365.650631:0:20957:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:2.0:1789499365.650634:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.650635:0:8416:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1789499365.650636:0:13832:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1789499365.650641:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724992 00000020:00000010:0.0:1789499365.650641:0:8416:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103b80. 00000100:00000001:3.0:1789499365.650642:0:20957:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1789499365.650666:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724480 00000020:00000010:0.0:1789499365.650666:0:8416:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3ec419200. 02000000:00000001:1.0:1789499365.650668:0:13832:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 02000000:00000001:3.0:1789499365.650671:0:20957:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000020:00000010:0.0:1789499365.650671:0:8416:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d0329e80. 00000100:00000001:1.0:1789499365.650672:0:13832:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.650674:0:20957:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000200:2.0:1789499365.650674:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.650677:0:20957:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.650677:0:13832:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.650678:0:8416:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3d02350c8. 02000000:00000001:3.0:1789499365.650684:0:20957:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1789499365.650685:0:13832:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650686:0:8416:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00100000:3.0:1789499365.650687:0:20957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724480 00000100:00000001:2.0:1789499365.650687:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1789499365.650689:0:8416:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1789499365.650692:0:8416:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.650693:0:20957:0:(genops.c:792:class_conn2export()) Process entered 00000100:00100000:1.0:1789499365.650693:0:13832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724992 00000020:00000040:3.0:1789499365.650697:0:20957:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffb5ba 00000100:00000001:2.0:1789499365.650697:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1789499365.650698:0:13832:0:(genops.c:792:class_conn2export()) Process entered 00000100:00000001:0.0:1789499365.650698:0:8416:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000001:3.0:1789499365.650701:0:20957:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000001:2.0:1789499365.650701:0:3616:0:(client.c:1593:after_reply()) Process entered 00000020:00000040:1.0:1789499365.650702:0:13832:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cbffb765 00000100:00000001:0.0:1789499365.650702:0:8416:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 02000000:00000001:2.0:1789499365.650705:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1789499365.650705:0:8416:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.650707:0:13832:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1789499365.650708:0:20957:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c22d1000 refcount=5 00000100:00000001:2.0:1789499365.650708:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.650709:0:8416:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.650713:0:20957:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691285430272 : -111382424121344 : ffff9ab2c22d1000) 00000100:00000001:2.0:1789499365.650713:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:1.0:1789499365.650713:0:13832:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c2575000 refcount=5 00000020:00000001:3.0:1789499365.650717:0:20957:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691285430272 : -111382424121344 : ffff9ab2c22d1000) 02000000:00000001:2.0:1789499365.650717:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.650719:0:13832:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691288199168 : -111382421352448 : ffff9ab2c2575000) 00000100:00000001:0.0:1789499365.650719:0:8416:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1789499365.650721:0:20957:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00001000:2.0:1789499365.650722:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3f5de0c60 time=24 v=5 (5 5 5 5) 00000100:00000001:0.0:1789499365.650722:0:8416:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000020:00000001:1.0:1789499365.650725:0:13832:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691288199168 : -111382421352448 : ffff9ab2c2575000) 00000020:00000010:3.0:1789499365.650726:0:20957:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00001000:2.0:1789499365.650727:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f5de0c18 time=66 v=5 (1 0 0 0) 00000100:00100000:0.0:1789499365.650729:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00000001:2.0:1789499365.650733:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000020:00000010:3.0:1789499365.650734:0:20957:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c36f5140. 00000100:00000001:1.0:1789499365.650734:0:13832:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000040:0.0:1789499365.650734:0:8416:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab3c7ead800 : new rpc_count 1 00000100:00000001:2.0:1789499365.650736:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650739:0:8416:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696564905088 : -111377144646528 : ffff9ab3fcdb7480) 00010000:00000001:2.0:1789499365.650740:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000020:00000010:1.0:1789499365.650741:0:13832:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510dc80. 00000100:00000001:3.0:1789499365.650742:0:20957:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00010000:00000001:2.0:1789499365.650743:0:3616:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.650746:0:20957:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00000040:0.0:1789499365.650747:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3fcdb7480 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.650748:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000020:00000010:1.0:1789499365.650748:0:13832:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c4816f00. 00000020:00000010:3.0:1789499365.650751:0:20957:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5380c00. 00000100:00000040:2.0:1789499365.650751:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 8589934603 00000100:00000001:2.0:1789499365.650755:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000020:00000010:3.0:1789499365.650757:0:20957:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fe700. 00000020:00000040:1.0:1789499365.650758:0:13832:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000100:00000001:2.0:1789499365.650759:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.650762:0:20957:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9708. 00000100:00000001:1.0:1789499365.650766:0:13832:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000100:00000040:2.0:1789499365.650767:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.650769:0:20957:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1789499365.650770:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.650771:0:20957:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000020:00000010:1.0:1789499365.650772:0:13832:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab3f5281400. 00000100:00000001:3.0:1789499365.650775:0:20957:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:0.0:1789499365.650776:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103b80. 00000100:00000001:3.0:1789499365.650780:0:20957:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000010:1.0:1789499365.650781:0:13832:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab2c4d1e280. 00000100:00000001:2.0:1789499365.650782:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.650782:0:8416:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.650783:0:20957:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:3.0:1789499365.650786:0:20957:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1789499365.650787:0:13832:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3f42b6c80. 00000100:00000001:2.0:1789499365.650788:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.650789:0:20957:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:0.0:1789499365.650789:0:8416:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103b80. 00000100:00000001:2.0:1789499365.650793:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.650795:0:13832:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1789499365.650799:0:13832:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789499365.650800:0:20957:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000040:2.0:1789499365.650800:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.650801:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3fcdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876424122724352:12345-0@lo:400:kworker.0 00000100:00000001:1.0:1789499365.650803:0:13832:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.650804:0:20957:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1789499365.650810:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00000001:1.0:1789499365.650812:0:13832:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000200:0.0:1789499365.650812:0:8416:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724352 00000100:00000040:3.0:1789499365.650814:0:20957:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c3004000 : new rpc_count 1 00000100:00000001:1.0:1789499365.650817:0:13832:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000020:00000001:0.0:1789499365.650817:0:8416:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000100:00000001:3.0:1789499365.650818:0:20957:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696564896128 : -111377144655488 : ffff9ab3fcdb5180) 00000100:00000001:1.0:1789499365.650821:0:13832:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.650822:0:8416:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000040:3.0:1789499365.650826:0:20957:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3fcdb5180 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:0.0:1789499365.650831:0:8416:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.650834:0:13832:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499365.650837:0:8416:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1789499365.650841:0:8416:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000100:00000001:1.0:1789499365.650845:0:13832:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000020:00000001:0.0:1789499365.650845:0:8416:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1789499365.650848:0:8416:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.650849:0:13832:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000020:00000001:0.0:1789499365.650853:0:8416:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000100:00100000:1.0:1789499365.650855:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000020:00000001:0.0:1789499365.650856:0:8416:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000040:1.0:1789499365.650860:0:13832:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c4741800 : new rpc_count 1 00000020:00000001:0.0:1789499365.650860:0:8416:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.650865:0:13832:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433838720 : -111377275712896 : ffff9ab3f50b8a80) 00000020:00000001:0.0:1789499365.650866:0:8416:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499365.650868:0:8416:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1789499365.650870:0:8416:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1789499365.650874:0:8416:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c377d400. 02000000:00000001:0.0:1789499365.650878:0:8416:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.650881:0:8416:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.650883:0:13832:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50b8a80 x1876424122725120/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:0.0:1789499365.650885:0:8416:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1789499365.650900:0:8416:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724352 00010000:00000001:0.0:1789499365.650905:0:8416:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:1.0:1789499365.650908:0:13832:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00010000:00000200:0.0:1789499365.650911:0:8416:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3fcdb7480 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:1.0:1789499365.650914:0:13832:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510db00. 00000100:00000001:3.0:1789499365.650915:0:20957:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789499365.650921:0:20957:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00000001:1.0:1789499365.650921:0:13832:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00010000:00000001:0.0:1789499365.650925:0:8416:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00000001:3.0:1789499365.650927:0:20957:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1789499365.650928:0:13832:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c510db00. 00010000:00000001:0.0:1789499365.650929:0:8416:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.650935:0:20957:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00001000:0.0:1789499365.650935:0:8416:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 00000100:00100000:1.0:1789499365.650940:0:13832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876424122725120:12345-0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.650942:0:8416:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00100000:3.0:1789499365.650946:0:20957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3fcdb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876424122724864:12345-0@lo:400:kworker.0 00000100:00000200:1.0:1789499365.650948:0:13832:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122725120 00000100:00000040:0.0:1789499365.650948:0:8416:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000020:00000001:1.0:1789499365.650954:0:13832:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000100:00000200:3.0:1789499365.650955:0:20957:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724864 00000100:00000001:0.0:1789499365.650955:0:8416:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000020:00000001:1.0:1789499365.650958:0:13832:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789499365.650960:0:20957:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1789499365.650962:0:13832:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789499365.650962:0:8416:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1789499365.650965:0:8416:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.650966:0:13832:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000001:0.0:1789499365.650969:0:8416:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000020:00000001:1.0:1789499365.650970:0:13832:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000020:00000001:1.0:1789499365.650975:0:13832:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000040:0.0:1789499365.650975:0:8416:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000001:1.0:1789499365.650978:0:13832:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000400:00000010:0.0:1789499365.650980:0:8416:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000020:00000001:1.0:1789499365.650982:0:13832:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1789499365.650987:0:13832:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000200:0.0:1789499365.650987:0:8416:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122724352, offset 224 00000020:00000001:1.0:1789499365.650991:0:13832:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499365.650994:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c27c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122723968:0@lo:400:kworker.0 00000020:00000001:1.0:1789499365.650996:0:13832:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1789499365.650999:0:13832:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1789499365.651003:0:13832:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1789499365.651006:0:13832:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3f8659000. 00000400:00000200:0.0:1789499365.651007:0:8416:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1789499365.651008:0:3615:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:1.0:1789499365.651012:0:13832:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.651013:0:3615:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.651018:0:13832:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1789499365.651019:0:8416:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000001:1.0:1789499365.651022:0:13832:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1789499365.651025:0:13832:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294968923, transno 0, xid 1876424122725120 00000400:00000200:0.0:1789499365.651029:0:8416:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909487000 00010000:00000001:1.0:1789499365.651030:0:13832:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000020:00000001:3.0:1789499365.651033:0:20957:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000001:2.0:1789499365.651033:0:29037:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789499365.651036:0:29037:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000020:00000001:3.0:1789499365.651037:0:20957:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00010000:00000200:1.0:1789499365.651038:0:13832:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50b8a80 x1876424122725120/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.651040:0:8416:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f01 [1] + 224 00000020:00000001:3.0:1789499365.651041:0:20957:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00100000:2.0:1789499365.651042:0:29037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000020:00000001:3.0:1789499365.651044:0:20957:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000100:00000040:2.0:1789499365.651047:0:29037:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c2575000 : new rpc_count 1 00000020:00000001:3.0:1789499365.651050:0:20957:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000100:00000001:2.0:1789499365.651052:0:29037:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433850368 : -111377275701248 : ffff9ab3f50bb800) 00000020:00000001:3.0:1789499365.651055:0:20957:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1789499365.651058:0:8416:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000001:3.0:1789499365.651059:0:20957:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000100:00000040:2.0:1789499365.651060:0:29037:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50bb800 x1876424122724992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.651062:0:20957:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1789499365.651065:0:20957:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1789499365.651065:0:13832:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000400:00000200:0.0:1789499365.651069:0:8416:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000020:00000001:3.0:1789499365.651070:0:20957:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00010000:00000001:1.0:1789499365.651070:0:13832:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.651076:0:20957:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000100:00001000:1.0:1789499365.651077:0:13832:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3ee9489e8 time=12 v=5 (1 1 1 1) 00000100:00000001:0.0:1789499365.651078:0:8416:0:(events.c:80:reply_in_callback()) Process entered 02000000:00000001:3.0:1789499365.651079:0:20957:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789499365.651084:0:20957:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3d04f1000. 00000100:00000001:1.0:1789499365.651085:0:13832:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000200:0.0:1789499365.651086:0:8416:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:3.0:1789499365.651087:0:20957:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.651090:0:29037:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:3.0:1789499365.651091:0:20957:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1789499365.651094:0:29037:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c6093f80. 00000020:00000001:3.0:1789499365.651096:0:20957:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.651098:0:13832:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 67 to 0@lo 00000100:00000001:2.0:1789499365.651099:0:29037:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00010000:00000040:3.0:1789499365.651100:0:20957:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724864 00010000:00000001:3.0:1789499365.651106:0:20957:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000020:00000010:2.0:1789499365.651106:0:29037:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c6093f80. 00000100:00000001:1.0:1789499365.651106:0:13832:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 02000000:00000001:1.0:1789499365.651112:0:13832:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1789499365.651116:0:13832:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00010000:00000200:3.0:1789499365.651117:0:20957:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3fcdb5180 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789499365.651117:0:29037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724992:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1789499365.651117:0:8416:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.651121:0:13832:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000200:2.0:1789499365.651127:0:29037:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724992 00000100:00000040:1.0:1789499365.651129:0:13832:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000001:2.0:1789499365.651132:0:29037:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1789499365.651136:0:29037:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000400:00000010:1.0:1789499365.651136:0:13832:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4000. 00000020:00000001:2.0:1789499365.651138:0:29037:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499365.651144:0:29037:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000100:00000200:1.0:1789499365.651144:0:13832:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424122725120, offset 224 00010000:00000001:3.0:1789499365.651145:0:20957:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000020:00000001:2.0:1789499365.651147:0:29037:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00010000:00000001:3.0:1789499365.651148:0:20957:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499365.651151:0:20957:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 00000020:00000001:2.0:1789499365.651151:0:29037:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1789499365.651154:0:29037:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499365.651155:0:13832:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:3.0:1789499365.651156:0:20957:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000020:00000001:2.0:1789499365.651156:0:29037:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1789499365.651159:0:29037:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000040:3.0:1789499365.651160:0:20957:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 68 to 0@lo 00000020:00000001:2.0:1789499365.651161:0:29037:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.651163:0:20957:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000020:00000001:2.0:1789499365.651163:0:29037:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000400:00000200:1.0:1789499365.651166:0:13832:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 02000000:00000001:3.0:1789499365.651167:0:20957:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000100:00000001:2.0:1789499365.651167:0:29037:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789499365.651170:0:20957:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.651170:0:29037:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000001:3.0:1789499365.651173:0:20957:0:(niobuf.c:69:ptl_send_buf()) Process entered 02000000:00000010:2.0:1789499365.651174:0:29037:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c3d80000. 00000100:00000040:3.0:1789499365.651176:0:20957:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 02000000:00000001:2.0:1789499365.651176:0:29037:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1789499365.651180:0:20957:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfa18. 00000100:00000001:2.0:1789499365.651180:0:29037:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.651180:0:13832:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6aa9909487300 00000020:00000001:2.0:1789499365.651184:0:29037:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.651185:0:20957:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122724864, offset 224 00010000:00000040:2.0:1789499365.651187:0:29037:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294967298, transno 0, xid 1876424122724992 00000400:00000200:1.0:1789499365.651190:0:13832:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0x35f15 [1] + 224 00010000:00000001:2.0:1789499365.651191:0:29037:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:2.0:1789499365.651197:0:29037:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50bb800 x1876424122724992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1789499365.651200:0:13832:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1789499365.651208:0:13832:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00010000:00000001:2.0:1789499365.651210:0:29037:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1789499365.651213:0:29037:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1789499365.651215:0:29037:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3ee9489e8 time=12 v=5 (1 1 1 1) 00000100:00000001:2.0:1789499365.651218:0:29037:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1789499365.651221:0:29037:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 69 to 0@lo 00000100:00000001:2.0:1789499365.651229:0:29037:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 02000000:00000001:2.0:1789499365.651231:0:29037:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1789499365.651233:0:29037:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.651235:0:29037:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789499365.651237:0:29037:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1789499365.651240:0:29037:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e2088. 00000100:00000001:0.0:1789499365.651247:0:8416:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1789499365.651263:0:20957:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000200:2.0:1789499365.651268:0:29037:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424122724992, offset 224 00000100:00000001:1.0:1789499365.651268:0:13832:0:(events.c:80:reply_in_callback()) Process entered 00000400:00000200:3.0:1789499365.651270:0:20957:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1789499365.651276:0:20957:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909487200 00000400:00000200:2.0:1789499365.651276:0:29037:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000200:1.0:1789499365.651276:0:13832:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.651281:0:8416:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000400:00000200:2.0:1789499365.651285:0:29037:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000010:0.0:1789499365.651287:0:8416:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 00000100:00000001:0.0:1789499365.651294:0:8416:0:(events.c:390:reply_out_callback()) Process entered 00000400:00000200:2.0:1789499365.651297:0:29037:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6aa9909487280 00000100:00000040:1.0:1789499365.651299:0:13832:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.651299:0:8416:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1789499365.651306:0:8416:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.651310:0:13832:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000040:0.0:1789499365.651311:0:8416:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 68 to 0@lo 00010000:00000001:0.0:1789499365.651315:0:8416:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:0.0:1789499365.651317:0:8416:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.651319:0:8416:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1789499365.651323:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3fcdb7480 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.651331:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3fcdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876424122724352:12345-0@lo:400:kworker.0 Request processed in 561us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789499365.651338:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00000040:0.0:1789499365.651340:0:8416:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab3c7ead800 : new rpc_count 0 00000100:00000001:0.0:1789499365.651342:0:8416:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1789499365.651344:0:8416:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1789499365.651346:0:8416:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329c80. 00000020:00000010:0.0:1789499365.651350:0:8416:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235708. 00000020:00000010:0.0:1789499365.651353:0:8416:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec418600. 00000020:00000040:0.0:1789499365.651356:0:8416:0:(genops.c:879:class_export_put()) PUTting export ffff9ab3c7ead800 : new refcount 4 00000100:00000001:0.0:1789499365.651358:0:8416:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.651366:0:8416:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1789499365.651367:0:8416:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1789499365.651376:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00000040:0.0:1789499365.651378:0:8416:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c4d2f800 : new rpc_count 1 00000100:00000001:0.0:1789499365.651380:0:8416:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691315722880 : -111382393828736 : ffff9ab2c3fb4a80) 00000100:00000040:0.0:1789499365.651384:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c3fb4a80 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.651392:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1789499365.651394:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab3f5103b80. 00000100:00000001:0.0:1789499365.651396:0:8416:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1789499365.651399:0:8416:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab3f5103b80. 00000100:00100000:0.0:1789499365.651402:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c3fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876424122724224:12345-0@lo:400:kworker.0 00000100:00000200:0.0:1789499365.651405:0:8416:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724224 00000020:00000001:0.0:1789499365.651407:0:8416:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:0.0:1789499365.651409:0:8416:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1789499365.651411:0:8416:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.651412:0:8416:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1789499365.651414:0:8416:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000020:00000001:0.0:1789499365.651416:0:8416:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1789499365.651418:0:8416:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499365.651420:0:8416:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1789499365.651421:0:8416:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1789499365.651422:0:8416:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.651424:0:8416:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499365.651426:0:8416:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1789499365.651428:0:8416:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1789499365.651431:0:8416:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c377f000. 02000000:00000001:0.0:1789499365.651433:0:8416:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.651435:0:8416:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.651436:0:8416:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1789499365.651438:0:8416:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724224 00010000:00000001:0.0:1789499365.651440:0:8416:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00010000:00000200:0.0:1789499365.651444:0:8416:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c3fb4a80 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1789499365.651450:0:8416:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1789499365.651457:0:8416:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1789499365.651459:0:8416:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 00000100:00000001:0.0:1789499365.651462:0:8416:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1789499365.651464:0:8416:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 69 to 0@lo 00000100:00000001:0.0:1789499365.651466:0:8416:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 02000000:00000001:0.0:1789499365.651468:0:8416:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1789499365.651469:0:8416:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.651471:0:8416:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1789499365.651473:0:8416:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1789499365.651475:0:8416:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000400:00000200:3.0:1789499365.651519:0:20957:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f11 [1] + 224 00000400:00000200:2.0:1789499365.651532:0:29037:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0x35f51 [1] + 224 00000400:00000200:3.0:1789499365.651533:0:20957:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1789499365.651536:0:20957:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1789499365.651537:0:29037:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:0.0:1789499365.651540:0:8416:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122724224, offset 224 00000400:00000200:2.0:1789499365.651541:0:29037:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1789499365.651541:0:13832:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4000 00000400:00000010:1.0:1789499365.651547:0:13832:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4000. 00000100:00000001:1.0:1789499365.651551:0:13832:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789499365.651553:0:20957:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.651553:0:29037:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:1.0:1789499365.651554:0:13832:0:(events.c:402:reply_out_callback()) Process leaving 00000400:00000200:0.0:1789499365.651557:0:8416:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:1.0:1789499365.651560:0:13832:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.651561:0:20957:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1789499365.651561:0:29037:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.651567:0:13832:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 68 to 0@lo 00000400:00000200:0.0:1789499365.651570:0:8416:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00010000:00000001:1.0:1789499365.651573:0:13832:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:1.0:1789499365.651576:0:13832:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.651580:0:13832:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000400:00000200:0.0:1789499365.651584:0:8416:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909486f80 00000100:00000040:3.0:1789499365.651586:0:20957:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.651586:0:29037:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1789499365.651588:0:13832:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50b8a80 x1876424122725120/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.651597:0:8416:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f21 [1] + 224 00000400:00000200:0.0:1789499365.651608:0:8416:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:3.0:1789499365.651616:0:20957:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499365.651616:0:29037:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1789499365.651617:0:8416:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00100000:1.0:1789499365.651620:0:13832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876424122725120:12345-0@lo:400:kworker.0 Request processed in 708us (2844us total) trans 0 rc 0/0 00000400:00000200:2.0:1789499365.651623:0:29037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2088 00000400:00000010:2.0:1789499365.651626:0:29037:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2088. 00000100:00000001:2.0:1789499365.651628:0:29037:0:(events.c:390:reply_out_callback()) Process entered 00000400:00000200:3.0:1789499365.651629:0:20957:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfa18 00000100:00000001:2.0:1789499365.651631:0:29037:0:(events.c:402:reply_out_callback()) Process leaving 00000400:00000010:3.0:1789499365.651632:0:20957:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfa18. 00000100:00000001:2.0:1789499365.651635:0:29037:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.651636:0:20957:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789499365.651638:0:20957:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1789499365.651638:0:8416:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000040:2.0:1789499365.651639:0:29037:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 67 to 0@lo 00000100:00100000:1.0:1789499365.651643:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00000040:1.0:1789499365.651662:0:13832:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c4741800 : new rpc_count 0 00000100:00000001:1.0:1789499365.651664:0:13832:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1789499365.651665:0:20957:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789499365.651666:0:29037:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000100:00000001:1.0:1789499365.651666:0:13832:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000001:2.0:1789499365.651670:0:29037:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1789499365.651670:0:13832:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab2c4d1e980. 00000100:00000200:0.0:1789499365.651670:0:8416:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789499365.651671:0:20957:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000020:00000001:2.0:1789499365.651676:0:29037:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00010000:00000001:3.0:1789499365.651677:0:20957:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000010:1.0:1789499365.651678:0:13832:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3f42b6d48. 00000020:00000001:3.0:1789499365.651680:0:20957:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.651683:0:29037:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50bb800 x1876424122724992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000010:1.0:1789499365.651684:0:13832:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3f5280c00. 00000020:00000001:3.0:1789499365.651685:0:20957:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1789499365.651691:0:20957:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3fcdb5180 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1789499365.651691:0:13832:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c4741800 : new refcount 4 00000100:00000001:1.0:1789499365.651696:0:13832:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789499365.651703:0:8416:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.651709:0:20957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3fcdb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876424122724864:12345-0@lo:400:kworker.0 Request processed in 792us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789499365.651709:0:29037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1876424122724992:12345-0@lo:400:kworker.0 Request processed in 614us (1563us total) trans 0 rc 0/0 00000100:00000001:1.0:1789499365.651712:0:6484:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1789499365.651716:0:6484:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1789499365.651722:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:2.0:1789499365.651726:0:29037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00000001:0.0:1789499365.651727:0:8416:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000040:1.0:1789499365.651728:0:6484:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab40093c000 : new rpc_count 1 00000100:00100000:3.0:1789499365.651732:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00000001:1.0:1789499365.651734:0:6484:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691337872256 : -111382371679360 : ffff9ab2c54d4380) 00000100:00000040:3.0:1789499365.651736:0:20957:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c3004000 : new rpc_count 0 00000100:00000040:2.0:1789499365.651736:0:29037:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c2575000 : new rpc_count 0 00000400:00000200:0.0:1789499365.651737:0:8416:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000100:00000001:3.0:1789499365.651741:0:20957:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789499365.651741:0:29037:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000040:1.0:1789499365.651743:0:6484:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c54d4380 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789499365.651743:0:8416:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 00000100:00000001:3.0:1789499365.651745:0:20957:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000001:2.0:1789499365.651745:0:29037:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000001:0.0:1789499365.651749:0:8416:0:(events.c:390:reply_out_callback()) Process entered 00000020:00000010:3.0:1789499365.651751:0:20957:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329300. 00000020:00000010:2.0:1789499365.651751:0:29037:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab2c4d1e280. 00000100:00000001:0.0:1789499365.651754:0:8416:0:(events.c:402:reply_out_callback()) Process leaving 00000020:00000010:3.0:1789499365.651757:0:20957:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d0235a28. 00000020:00000010:2.0:1789499365.651757:0:29037:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3f42b6c80. 00000100:00000001:0.0:1789499365.651760:0:8416:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.651761:0:6484:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789499365.651763:0:20957:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec419000. 00000020:00000010:2.0:1789499365.651763:0:29037:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3f5281400. 00000100:00000040:0.0:1789499365.651767:0:8416:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000020:00000010:1.0:1789499365.651768:0:6484:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c510db00. 00000020:00000040:3.0:1789499365.651770:0:20957:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c3004000 : new refcount 4 00000020:00000040:2.0:1789499365.651770:0:29037:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c2575000 : new refcount 4 00010000:00000001:0.0:1789499365.651774:0:8416:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000100:00000001:2.0:1789499365.651775:0:29037:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1789499365.651775:0:6484:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.651776:0:20957:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1789499365.651777:0:8416:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.651782:0:8416:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000020:00000010:1.0:1789499365.651783:0:6484:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c510db00. 00000100:00000040:0.0:1789499365.651789:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb4a80 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.651790:0:20957:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00100000:1.0:1789499365.651792:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c54d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876424122725376:12345-0@lo:400:kworker.0 00000100:00000001:3.0:1789499365.651793:0:20957:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000200:1.0:1789499365.651803:0:6484:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122725376 00000100:00100000:3.0:1789499365.651806:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000020:00000001:1.0:1789499365.651808:0:6484:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000100:00000040:3.0:1789499365.651809:0:20957:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c22d1000 : new rpc_count 1 00000020:00000001:1.0:1789499365.651812:0:6484:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000001:3.0:1789499365.651813:0:20957:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632696433847680 : -111377275703936 : ffff9ab3f50bad80) 00000020:00000001:1.0:1789499365.651816:0:6484:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.651822:0:20957:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab3f50bad80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:1.0:1789499365.651823:0:6484:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1789499365.651827:0:6484:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000100:00100000:0.0:1789499365.651833:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c3fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876424122724224:12345-0@lo:400:kworker.0 Request processed in 437us (2926us total) trans 0 rc 0/0 00000020:00000001:1.0:1789499365.651834:0:6484:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1789499365.651839:0:6484:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1789499365.651844:0:6484:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000100:00100000:0.0:1789499365.651846:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00000040:0.0:1789499365.651849:0:8416:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c4d2f800 : new rpc_count 0 00000100:00000001:3.0:1789499365.651852:0:20957:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000100:00000001:0.0:1789499365.651853:0:8416:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000020:00000001:1.0:1789499365.651854:0:6484:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000001:0.0:1789499365.651856:0:8416:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1789499365.651857:0:20957:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000020:00000001:1.0:1789499365.651858:0:6484:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1789499365.651861:0:8416:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fef80. 00000100:00000001:3.0:1789499365.651863:0:20957:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000001:1.0:1789499365.651863:0:6484:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000020:00000010:0.0:1789499365.651866:0:8416:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9e10. 00000020:00000010:3.0:1789499365.651869:0:20957:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00000001:1.0:1789499365.651869:0:6484:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000020:00000010:0.0:1789499365.651872:0:8416:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5380800. 02000000:00000001:1.0:1789499365.651873:0:6484:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00100000:3.0:1789499365.651879:0:20957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab3f50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876424122724480:12345-0@lo:400:kworker.0 02000000:00000010:1.0:1789499365.651881:0:6484:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3f865b400. 00000020:00000040:0.0:1789499365.651881:0:8416:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c4d2f800 : new refcount 4 00000100:00000200:3.0:1789499365.651884:0:20957:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724480 00000100:00000001:0.0:1789499365.651898:0:8416:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.651899:0:20957:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 02000000:00000001:1.0:1789499365.651899:0:6484:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.651902:0:20957:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789499365.651905:0:20957:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.651905:0:6484:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.651912:0:20957:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1789499365.651912:0:6484:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.651915:0:20957:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00010000:00000040:1.0:1789499365.651916:0:6484:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122725376 00000020:00000001:3.0:1789499365.651919:0:20957:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00010000:00000001:1.0:1789499365.651921:0:6484:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000020:00000001:3.0:1789499365.651923:0:20957:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.651926:0:20957:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00010000:00000200:1.0:1789499365.651927:0:6484:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c54d4380 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.651928:0:20957:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1789499365.651931:0:20957:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.651935:0:20957:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:3.0:1789499365.651939:0:20957:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789499365.651943:0:20957:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00010000:00000001:1.0:1789499365.651943:0:6484:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1789499365.651948:0:6484:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499365.651950:0:20957:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3d04f3000. 00000100:00001000:1.0:1789499365.651952:0:6484:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 02000000:00000001:3.0:1789499365.651953:0:20957:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:0.0:1789499365.651954:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000001:3.0:1789499365.651960:0:20957:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.651960:0:6484:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000020:00000040:0.0:1789499365.651962:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000020:00000001:3.0:1789499365.651965:0:20957:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1789499365.651965:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00000040:1.0:1789499365.651965:0:6484:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000400:00000001:2.0:1789499365.651968:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000100:00000001:1.0:1789499365.651969:0:6484:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000100:00080000:0.0:1789499365.651969:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000010:2.0:1789499365.651974:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec5835d8. 02000000:00000001:1.0:1789499365.651974:0:6484:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000020:00000040:0.0:1789499365.651975:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff9ab3ed933380) now 12 - evictor 02000000:00000001:1.0:1789499365.651976:0:6484:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.651979:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2c38 00010000:00000040:3.0:1789499365.651980:0:20957:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724480 00000100:00000001:1.0:1789499365.651982:0:6484:0:(niobuf.c:69:ptl_send_buf()) Process entered 00010000:00000001:3.0:1789499365.651983:0:20957:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000400:00000010:2.0:1789499365.651983:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2c38. 00000100:00080000:0.0:1789499365.651983:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:1.0:1789499365.651988:0:6484:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1789499365.651989:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00000100:00000001:2.0:1789499365.651990:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00010000:00000200:3.0:1789499365.651992:0:20957:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab3f50bad80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1789499365.651992:0:6484:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab4009a4000. 00000100:00000200:2.0:1789499365.651994:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1789499365.651997:0:6484:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122725376, offset 224 00000400:00000200:1.0:1789499365.652006:0:6484:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000200:2.0:1789499365.652011:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1789499365.652016:0:6484:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1789499365.652025:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499365.652029:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1789499365.652029:0:6484:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909487400 00000100:00000001:2.0:1789499365.652034:0:3616:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1789499365.652036:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000400:00000200:1.0:1789499365.652039:0:6484:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f35 [1] + 224 00000100:00000001:2.0:1789499365.652040:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789499365.652043:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652046:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1789499365.652048:0:6484:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00001000:2.0:1789499365.652052:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3fcf04c60 time=144 v=5 (5 5 5 5) 00000100:00080000:0.0:1789499365.652055:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000400:00000200:1.0:1789499365.652057:0:6484:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00001000:2.0:1789499365.652059:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcf04c18 time=144 v=5 (1 1 1 1) 00000020:00000040:0.0:1789499365.652060:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff9ab3f5dfb380) now 10 - evictor 00000100:00000001:1.0:1789499365.652063:0:6484:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.652064:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499365.652067:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:1.0:1789499365.652068:0:6484:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789499365.652070:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1789499365.652074:0:3616:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.652079:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1789499365.652079:0:6484:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.652082:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294967298 00000100:00000001:2.0:1789499365.652086:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789499365.652088:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1789499365.652092:0:6484:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1789499365.652096:0:6484:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4000 00000400:00000010:1.0:1789499365.652099:0:6484:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4000. 00000100:00000001:1.0:1789499365.652102:0:6484:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000040:2.0:1789499365.652103:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.652103:0:6484:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1789499365.652107:0:6484:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1789499365.652113:0:6484:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00010000:00000001:1.0:1789499365.652117:0:6484:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000100:00000001:2.0:1789499365.652118:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000020:00000001:1.0:1789499365.652119:0:6484:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1789499365.652123:0:6484:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000001:2.0:1789499365.652124:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789499365.652127:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1789499365.652127:0:6484:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c54d4380 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.652134:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789499365.652138:0:20957:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00100000:1.0:1789499365.652139:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c54d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876424122725376:12345-0@lo:400:kworker.0 Request processed in 375us (2745us total) trans 0 rc 0/0 00010000:00000001:3.0:1789499365.652146:0:20957:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499365.652151:0:20957:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 00000100:00100000:2.0:1789499365.652152:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724992:0@lo:400:kworker.0 00000100:00100000:1.0:1789499365.652153:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00000001:3.0:1789499365.652157:0:20957:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1789499365.652159:0:6484:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab40093c000 : new rpc_count 0 00000100:00000040:3.0:1789499365.652162:0:20957:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000400:00000001:2.0:1789499365.652162:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00000001:1.0:1789499365.652162:0:6484:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000400:00000001:2.0:1789499365.652164:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000100:00000001:1.0:1789499365.652165:0:6484:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000001:3.0:1789499365.652166:0:20957:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000400:00000010:2.0:1789499365.652167:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec583f78. 00000020:00000010:1.0:1789499365.652169:0:6484:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d0329e80. 02000000:00000001:3.0:1789499365.652170:0:20957:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00000400:00000200:2.0:1789499365.652171:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2f68 02000000:00000001:3.0:1789499365.652173:0:20957:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1789499365.652173:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2f68. 00000020:00000010:1.0:1789499365.652174:0:6484:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3d02350c8. 00000100:00000001:3.0:1789499365.652176:0:20957:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:2.0:1789499365.652177:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000040:3.0:1789499365.652181:0:20957:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000010:1.0:1789499365.652182:0:6484:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab3ec419200. 00000100:00000200:2.0:1789499365.652183:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1789499365.652184:0:20957:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccfa18. 00000100:00000200:3.0:1789499365.652189:0:20957:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122724480, offset 224 00000020:00000040:1.0:1789499365.652190:0:6484:0:(genops.c:879:class_export_put()) PUTting export ffff9ab40093c000 : new refcount 4 00000400:00000200:3.0:1789499365.652194:0:20957:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000200:2.0:1789499365.652194:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1789499365.652196:0:6484:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1789499365.652202:0:20957:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1789499365.652204:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1789499365.652205:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1789499365.652208:0:20957:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909487080 00000100:00000001:2.0:1789499365.652208:0:3616:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1789499365.652209:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789499365.652211:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000400:00000200:3.0:1789499365.652213:0:20957:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f45 [1] + 224 00000100:00000001:2.0:1789499365.652213:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652215:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1789499365.652217:0:20957:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00001000:2.0:1789499365.652219:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab2c4b19c60 time=77 v=5 (5 0 0 0) 00000400:00000200:3.0:1789499365.652221:0:20957:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00001000:2.0:1789499365.652222:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab2c4b19c18 time=77 v=5 (1 0 0 0) 00000100:00000001:3.0:1789499365.652223:0:20957:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.652224:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499365.652225:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.652227:0:20957:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789499365.652227:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1789499365.652229:0:3616:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.652232:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1789499365.652233:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968923 00000100:00000040:3.0:1789499365.652236:0:20957:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.652240:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789499365.652242:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.652243:0:20957:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000040:2.0:1789499365.652246:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1789499365.652248:0:20957:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfa18 00000400:00000010:3.0:1789499365.652250:0:20957:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfa18. 00000100:00000001:3.0:1789499365.652252:0:20957:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1789499365.652252:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.652254:0:20957:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1789499365.652254:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1789499365.652256:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.652257:0:20957:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.652259:0:20957:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000100:00000040:2.0:1789499365.652259:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789499365.652262:0:20957:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:3.0:1789499365.652263:0:20957:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.652265:0:20957:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00100000:2.0:1789499365.652266:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876424122725120:0@lo:400:kworker.0 00000100:00000040:3.0:1789499365.652269:0:20957:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab3f50bad80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000001:2.0:1789499365.652271:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1789499365.652272:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1789499365.652274:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec583528. 00000400:00000200:2.0:1789499365.652276:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e22a8 00000400:00000010:2.0:1789499365.652278:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e22a8. 00000100:00000001:2.0:1789499365.652280:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1789499365.652283:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.652286:0:20957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab3f50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876424122724480:12345-0@lo:400:kworker.0 Request processed in 445us (2512us total) trans 0 rc 0/0 00000100:00000200:2.0:1789499365.652291:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.652293:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00000040:3.0:1789499365.652295:0:20957:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c22d1000 : new rpc_count 0 00000100:00000001:3.0:1789499365.652297:0:20957:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1789499365.652297:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.652299:0:20957:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000001:2.0:1789499365.652299:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.652300:0:3616:0:(client.c:1593:after_reply()) Process entered 00000020:00000010:3.0:1789499365.652301:0:20957:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fe700. 02000000:00000001:2.0:1789499365.652302:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789499365.652303:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000020:00000010:3.0:1789499365.652304:0:20957:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9708. 00000100:00000001:2.0:1789499365.652305:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.652307:0:20957:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5380c00. 02000000:00000001:2.0:1789499365.652307:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:3.0:1789499365.652310:0:20957:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c22d1000 : new refcount 4 00000100:00001000:2.0:1789499365.652310:0:3616:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3fcd72460 time=12 v=5 (5 5 5 5) 00000100:00000001:3.0:1789499365.652312:0:20957:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00001000:2.0:1789499365.652313:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3fcd72418 time=12 v=5 (1 1 1 1) 00000100:00000001:2.0:1789499365.652315:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499365.652316:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.652329:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789499365.652331:0:3614:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1789499365.652334:0:3614:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789499365.652335:0:3614:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1789499365.652337:0:3614:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3d0963d68. 00000400:00000200:3.0:1789499365.652339:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccfe58 00000400:00000010:3.0:1789499365.652341:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccfe58. 00000100:00000001:3.0:1789499365.652343:0:3614:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789499365.652346:0:3614:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1789499365.652353:0:3614:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.652358:0:3614:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.652359:0:3614:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.652360:0:3614:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1789499365.652362:0:3614:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789499365.652363:0:3614:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.652364:0:3614:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.652366:0:3614:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499365.652370:0:3614:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab2c4741460 time=72 v=36 (36 0 0 0) 00000100:00001000:3.0:1789499365.652373:0:3614:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab2c4741418 time=72 v=5 (1 0 0 0) 00000100:00000001:3.0:1789499365.652376:0:3614:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.652383:0:3614:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1789499365.652386:0:3614:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1789499365.652388:0:3614:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.652390:0:3614:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000001:0.0:1789499365.652390:0:3613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000040:3.0:1789499365.652393:0:3614:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000200:0.0:1789499365.652395:0:3613:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000001:3.0:1789499365.652396:0:3614:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1789499365.652399:0:3614:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:0.0:1789499365.652403:0:3613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c2014a80. 00000100:00000040:3.0:1789499365.652404:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1789499365.652409:0:3613:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c2014a80 x1876424122724736 msgsize 224 00000100:00000001:3.0:1789499365.652417:0:3614:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00100000:0.0:1789499365.652418:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:3.0:1789499365.652421:0:3614:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.652424:0:3614:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.652427:0:3613:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000040:3.0:1789499365.652428:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.652436:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a42a8 00000100:00100000:3.0:1789499365.652437:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876424122725376:0@lo:400:kworker.0 00000400:00000010:0.0:1789499365.652440:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a42a8. 00000100:00000001:0.0:1789499365.652445:0:3613:0:(events.c:35:request_out_callback()) Process entered 00000400:00000001:3.0:1789499365.652446:0:3614:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789499365.652449:0:3614:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1789499365.652452:0:3614:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3d0963898. 00000100:00000200:0.0:1789499365.652452:0:3613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1789499365.652457:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf220 00000400:00000010:3.0:1789499365.652461:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf220. 00000100:00000001:3.0:1789499365.652466:0:3614:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:0.0:1789499365.652469:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000200:3.0:1789499365.652472:0:3614:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1789499365.652475:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1789499365.652479:0:3616:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.652481:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1789499365.652486:0:3614:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1789499365.652491:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1789499365.652493:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294967320 00000100:00000001:2.0:1789499365.652497:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789499365.652499:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.652504:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.652505:0:3614:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000040:2.0:1789499365.652505:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.652507:0:3614:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.652509:0:3613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1789499365.652510:0:3614:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1789499365.652514:0:3614:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1789499365.652514:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.652515:0:3614:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789499365.652516:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.652517:0:3614:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.652518:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.652518:0:3613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.652519:0:3614:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.652522:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00001000:3.0:1789499365.652526:0:3614:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab3f5f60460 time=13 v=36 (36 36 5 5) 00000100:00000040:0.0:1789499365.652526:0:3613:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 11245 usecs (12 jiffies) 00000100:00100000:2.0:1789499365.652530:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876424122724608:0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.652532:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS new deadline estimation for cpu 0 is 4296591889 00000100:00001000:3.0:1789499365.652535:0:3614:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f5f60418 time=72 v=5 (1 0 0 0) 00000100:00000001:2.0:1789499365.652535:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.652537:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS request active for cpu 0, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.652539:0:3614:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1789499365.652539:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000001:3.0:1789499365.652541:0:3614:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.652543:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS new deadline estimation for cpu 1 is 4296591889 00010000:00000001:3.0:1789499365.652544:0:3614:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000100:00000040:2.0:1789499365.652544:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c27c9180 x1876424122723968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1789499365.652547:0:3614:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.652549:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS request active for cpu 1, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.652550:0:3614:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1789499365.652553:0:3614:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000001:3.0:1789499365.652556:0:3614:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1789499365.652556:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00000001:0.0:1789499365.652556:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS new deadline estimation for cpu 2 is 4296591889 00000100:00000001:3.0:1789499365.652559:0:3614:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652559:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000100:00000001:0.0:1789499365.652561:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS request active for cpu 2, keep current deadline 4296593544 02000000:00000010:2.0:1789499365.652562:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c492ca00. 00000100:00000040:3.0:1789499365.652564:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.652566:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS new deadline estimation for cpu 3 is 4296591889 02000000:00000001:2.0:1789499365.652568:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000001:0.0:1789499365.652570:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: PM QoS request active for cpu 3, keep current deadline 4296593544 00000020:00000001:2.0:1789499365.652571:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000100:00000001:3.0:1789499365.652573:0:3614:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000020:00000040:2.0:1789499365.652573:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab3f5de0800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000001:0.0:1789499365.652576:0:3613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.652577:0:3614:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000020:00000001:2.0:1789499365.652577:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 00000100:00000001:3.0:1789499365.652580:0:3614:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 02000000:00000010:2.0:1789499365.652581:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665000. 00000100:00000001:0.0:1789499365.652582:0:3613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652585:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 00000100:00000040:3.0:1789499365.652586:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.652586:0:3613:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 02000000:00000001:2.0:1789499365.652587:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1789499365.652591:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c27c9180. 00000100:00000001:2.0:1789499365.652594:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000040:0.0:1789499365.652595:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.652596:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c27c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876424122724352:0@lo:400:kworker.0 00000100:00000001:2.0:1789499365.652596:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.652599:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789499365.652603:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb6a00 x1876424122724992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000001:3.0:1789499365.652606:0:3614:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789499365.652608:0:3614:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1789499365.652610:0:3614:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3d0963e18. 00000400:00000200:3.0:1789499365.652614:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf440 00000400:00000010:3.0:1789499365.652617:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf440. 00000100:00000001:3.0:1789499365.652620:0:3614:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:2.0:1789499365.652624:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00000001:0.0:1789499365.652624:0:3613:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000200:3.0:1789499365.652625:0:3614:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.652628:0:3613:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652630:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789499365.652634:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c26c5c00. 02000000:00000001:0.0:1789499365.652635:0:3613:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1789499365.652637:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000200:3.0:1789499365.652638:0:3614:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:2.0:1789499365.652639:0:3616:0:(genops.c:1216:class_import_put()) Process entered 02000000:00000001:0.0:1789499365.652640:0:3613:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000020:00000040:2.0:1789499365.652641:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab3fcf04800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000001:3.0:1789499365.652669:0:3614:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.652671:0:3614:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.652673:0:3614:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1789499365.652674:0:3614:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789499365.652675:0:3614:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.652677:0:3614:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.652683:0:3614:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499365.652688:0:3614:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab2c32dec60 time=151 v=36 (36 5 5 101) 00000100:00001000:3.0:1789499365.652691:0:3614:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab2c32dec18 time=151 v=5 (1 1 1 1) 00000100:00000001:3.0:1789499365.652693:0:3614:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.652695:0:3614:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1789499365.652696:0:3614:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1789499365.652698:0:3614:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.652700:0:3614:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1789499365.652702:0:3614:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000001:3.0:1789499365.652704:0:3614:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1789499365.652705:0:3614:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.652709:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.652714:0:3614:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1789499365.652716:0:3614:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.652717:0:3614:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:0.0:1789499365.652721:0:3613:0:(sec.c:790:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.652723:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.652730:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ab2c3fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876424122725248:0@lo:400:kworker.0 00000100:00100000:3.0:1789499365.652735:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876424122724864:0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.652737:0:3613:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1789499365.652743:0:3613:0:(sec.c:1086:sptlrpc_cli_wrap_request()) Process entered 00000400:00000001:3.0:1789499365.652744:0:3614:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789499365.652746:0:3614:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 02000000:00000001:0.0:1789499365.652746:0:3613:0:(sec.c:1123:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1789499365.652750:0:3614:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3d0963370. 02000000:00000001:0.0:1789499365.652751:0:3613:0:(sec.c:1870:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000200:3.0:1789499365.652753:0:3614:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf880 00000400:00000010:3.0:1789499365.652757:0:3614:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf880. 02000000:00000010:0.0:1789499365.652757:0:3613:0:(sec_null.c:178:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9ab3ec419c00. 00000100:00000001:3.0:1789499365.652761:0:3614:0:(events.c:80:reply_in_callback()) Process entered 02000000:00000001:0.0:1789499365.652762:0:3613:0:(sec.c:1880:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1789499365.652766:0:3614:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789499365.652776:0:3613:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at ffff9ab3f5ea4160. 00000100:00000200:3.0:1789499365.652777:0:3614:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789499365.652781:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970550. 00000100:00000001:3.0:1789499365.652786:0:3614:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.652789:0:3614:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1789499365.652789:0:3613:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1876424122725248, portal 4 00000100:00000001:3.0:1789499365.652793:0:3614:0:(client.c:1593:after_reply()) Process entered 00000100:00000001:0.0:1789499365.652795:0:3613:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1789499365.652797:0:3613:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446632691315726464 : -111382393825152 : ffff9ab2c3fb5880) 02000000:00000001:3.0:1789499365.652801:0:3614:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789499365.652803:0:3614:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.652806:0:3614:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.652806:0:3613:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:3.0:1789499365.652809:0:3614:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1789499365.652814:0:3614:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3f4287460 time=34 v=5 (5 5 5 5) 00000100:00000001:0.0:1789499365.652819:0:3613:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00001000:3.0:1789499365.652821:0:3614:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f4287418 time=77 v=5 (1 0 0 0) 00000100:00000040:0.0:1789499365.652826:0:3613:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:3.0:1789499365.652827:0:3614:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.652831:0:3614:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499365.652831:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 00000400:00000010:0.0:1789499365.652831:0:3613:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab400970110. 02000000:00000010:2.0:1789499365.652834:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665700. 00010000:00000001:3.0:1789499365.652836:0:3614:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000100:00000200:0.0:1789499365.652837:0:3613:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1876424122725248, offset 0 00010000:00000001:3.0:1789499365.652838:0:3614:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1789499365.652838:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789499365.652840:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1789499365.652843:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb6a00. 00000400:00000200:0.0:1789499365.652845:0:3613:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1789499365.652848:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1789499365.652851:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1789499365.652855:0:3613:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1789499365.652856:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789499365.652863:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb4e00 x1876424122725120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.652864:0:3613:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 28 MB=0x6aa9909487380 00000400:00000200:0.0:1789499365.652874:0:3613:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1c from 12345-0@lo of length 224/224 into md 0x28709 [8] + 7168 00000100:00000001:2.0:1789499365.652878:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1789499365.652880:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789499365.652882:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab3d32e5800. 00000400:00000200:0.0:1789499365.652882:0:3613:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000001:2.0:1789499365.652898:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1789499365.652902:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000400:00000200:0.0:1789499365.652902:0:3613:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000020:00000040:2.0:1789499365.652906:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab2c4b19800 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000001:0.0:1789499365.652908:0:3613:0:(events.c:290:request_in_callback()) Process entered 00000100:00000001:3.0:1789499365.652910:0:3614:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499365.652910:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 00000100:00000200:0.0:1789499365.652911:0:3613:0:(events.c:300:request_in_callback()) event type 2, status 0, service ost 02000000:00000010:2.0:1789499365.652913:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665200. 00000100:00000040:3.0:1789499365.652916:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1789499365.652917:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789499365.652918:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789499365.652919:0:3613:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9ab2c2015f80. 00000100:00000010:2.0:1789499365.652921:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb4e00. 00000100:00000001:3.0:1789499365.652926:0:3614:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1789499365.652926:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000040:0.0:1789499365.652926:0:3613:0:(events.c:341:request_in_callback()) incoming req@ffff9ab2c2015f80 x1876424122725248 msgsize 224 00000100:00000001:2.0:1789499365.652929:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.652931:0:3614:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.652932:0:3614:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.652932:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1789499365.652937:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb7480 x1876424122724608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789499365.652940:0:3614:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.652940:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:2.0:1789499365.652948:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00100000:3.0:1789499365.652950:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c27c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d51d89-6692-45db-a733-1d410e949bbe:3614:1876424122723840:0@lo:400:kworker.0 02000000:00000001:2.0:1789499365.652950:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1789499365.652951:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab3c906ea00. 00000100:00000001:0.0:1789499365.652952:0:3613:0:(events.c:377:request_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.652954:0:3614:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:2.0:1789499365.652954:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1789499365.652956:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000100:00000001:3.0:1789499365.652957:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000020:00000040:2.0:1789499365.652958:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab3fcd72000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000400:00000200:0.0:1789499365.652960:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970110 00000100:00000040:3.0:1789499365.652961:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb4000 x1876424122725376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1789499365.652965:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970110. 00000020:00000001:2.0:1789499365.652966:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:2.0:1789499365.652969:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665600. 00000100:00000001:0.0:1789499365.652970:0:3613:0:(events.c:35:request_out_callback()) Process entered 02000000:00000001:2.0:1789499365.652974:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1789499365.652976:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000200:0.0:1789499365.652978:0:3613:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.652979:0:3614:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00000010:2.0:1789499365.652979:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb7480. 02000000:00000001:3.0:1789499365.652982:0:3614:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000100:00000001:2.0:1789499365.652983:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 02000000:00000010:3.0:1789499365.652984:0:3614:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c5381800. 00000100:00000001:2.0:1789499365.652985:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:3.0:1789499365.652988:0:3614:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000001:2.0:1789499365.652989:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.652991:0:3614:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789499365.652992:0:3614:0:(genops.c:1222:class_import_put()) import ffff9ab2c4741000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:2.0:1789499365.652992:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1789499365.652993:0:3616:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000020:00000001:3.0:1789499365.652994:0:3614:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:3.0:1789499365.652995:0:3614:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665100. 02000000:00000001:3.0:1789499365.652997:0:3614:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1789499365.652999:0:3614:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1789499365.653000:0:3614:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb4000. 00000100:00000001:3.0:1789499365.653006:0:3614:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653013:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653015:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789499365.653019:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c27c8e00 x1876424122724352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653030:0:3614:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1789499365.653031:0:3614:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1789499365.653033:0:3614:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c5381000. 02000000:00000001:3.0:1789499365.653035:0:3614:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1789499365.653036:0:3614:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789499365.653037:0:3614:0:(genops.c:1222:class_import_put()) import ffff9ab3f5f60000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000020:00000001:3.0:1789499365.653039:0:3614:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:3.0:1789499365.653040:0:3614:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665d00. 02000000:00000001:3.0:1789499365.653042:0:3614:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1789499365.653043:0:3614:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1789499365.653044:0:3614:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c27c8e00. 00000100:00000001:3.0:1789499365.653047:0:3614:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653048:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653049:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789499365.653052:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb6300 x1876424122724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653057:0:3614:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1789499365.653058:0:3614:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1789499365.653059:0:3614:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c5380a00. 02000000:00000001:3.0:1789499365.653061:0:3614:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1789499365.653062:0:3614:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789499365.653063:0:3614:0:(genops.c:1222:class_import_put()) import ffff9ab2c32de800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000020:00000001:3.0:1789499365.653067:0:3614:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:3.0:1789499365.653069:0:3614:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665a00. 02000000:00000001:3.0:1789499365.653074:0:3614:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1789499365.653076:0:3614:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000001:0.0:1789499365.653076:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000010:3.0:1789499365.653077:0:3614:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb6300. 00000100:00000001:3.0:1789499365.653081:0:3614:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653083:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789499365.653084:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653085:0:3614:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789499365.653092:0:3614:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c27c8a80 x1876424122723840/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.653099:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653103:0:3613:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1789499365.653114:0:3614:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1789499365.653116:0:3614:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000100:00000001:0.0:1789499365.653116:0:3613:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499365.653119:0:3614:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c5380000. 00000100:00000040:0.0:1789499365.653122:0:3613:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9926 usecs (10 jiffies) 02000000:00000001:3.0:1789499365.653123:0:3614:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1789499365.653125:0:3614:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789499365.653128:0:3614:0:(genops.c:1222:class_import_put()) import ffff9ab3f4287000 refcount=3 obd=MGC192.168.206.127@tcp 00000100:00000001:0.0:1789499365.653128:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4296591888 00000020:00000001:3.0:1789499365.653134:0:3614:0:(genops.c:1229:class_import_put()) Process leaving 00000100:00000001:0.0:1789499365.653134:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS request active for cpu 0, keep current deadline 4296593544 02000000:00000010:3.0:1789499365.653135:0:3614:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665800. 02000000:00000001:3.0:1789499365.653139:0:3614:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1789499365.653141:0:3614:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000001:0.0:1789499365.653141:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4296591888 00000100:00000010:3.0:1789499365.653145:0:3614:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c27c8a80. 00000100:00000001:0.0:1789499365.653146:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS request active for cpu 1, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.653148:0:3614:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653150:0:3614:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653152:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653156:0:3614:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1789499365.653157:0:3614:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653159:0:3614:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1789499365.653161:0:3614:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:3.0:1789499365.653175:0:3616:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1789499365.653176:0:3616:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1789499365.653178:0:3616:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3ec583738. 00000400:00000200:3.0:1789499365.653180:0:3616:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e2220 00000400:00000010:3.0:1789499365.653182:0:3616:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e2220. 00000100:00000001:3.0:1789499365.653185:0:3616:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789499365.653188:0:3616:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1789499365.653195:0:3616:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653200:0:3616:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1789499365.653201:0:3616:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653203:0:3616:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1789499365.653204:0:3616:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789499365.653205:0:3616:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.653206:0:3616:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.653208:0:3616:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653213:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4296591888 00000100:00001000:3.0:1789499365.653218:0:3616:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab2c22d6460 time=13 v=36 (36 36 5 5) 00000100:00000001:0.0:1789499365.653218:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS request active for cpu 2, keep current deadline 4296593544 00000100:00000001:0.0:1789499365.653222:0:3613:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4296591888 00000100:00001000:3.0:1789499365.653224:0:3616:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab2c22d6418 time=13 v=5 (1 1 1 1) 00000100:00000001:0.0:1789499365.653228:0:3613:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: PM QoS request active for cpu 3, keep current deadline 4296593544 00000100:00000001:3.0:1789499365.653229:0:3616:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.653231:0:3616:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653235:0:3613:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:3.0:1789499365.653236:0:3616:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1789499365.653239:0:3616:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653240:0:3613:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653243:0:3616:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1789499365.653247:0:3616:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000400:00000001:0.0:1789499365.653247:0:3613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00000001:3.0:1789499365.653250:0:3616:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1789499365.653252:0:3616:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1789499365.653256:0:3613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1789499365.653259:0:3613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3fcfbbdc0. 00000100:00000040:3.0:1789499365.653262:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1789499365.653265:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4b28 00000400:00000010:0.0:1789499365.653269:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4b28. 00000100:00000001:3.0:1789499365.653275:0:3616:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.653276:0:3613:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000001:3.0:1789499365.653279:0:3616:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1789499365.653282:0:3616:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1789499365.653284:0:3613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789499365.653289:0:3616:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1789499365.653308:0:3613:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789499365.653310:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c27cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876424122724480:0@lo:400:kworker.0 00000100:00000001:3.0:1789499365.653318:0:3616:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653321:0:3616:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1789499365.653326:0:3616:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c27cbb80 x1876424122724480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.653326:0:3613:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1789499365.653330:0:3613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.653335:0:3613:0:(client.c:1593:after_reply()) Process entered 00000100:00000001:3.0:1789499365.653339:0:3616:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1789499365.653339:0:3613:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 02000000:00000001:3.0:1789499365.653343:0:3616:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000100:00000001:0.0:1789499365.653343:0:3613:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.653347:0:3613:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1789499365.653348:0:3616:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab2c492da00. 02000000:00000001:3.0:1789499365.653353:0:3616:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 02000000:00000001:0.0:1789499365.653354:0:3613:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.653356:0:3616:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:3.0:1789499365.653358:0:3616:0:(genops.c:1222:class_import_put()) import ffff9ab2c22d6000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000001:3.0:1789499365.653360:0:3616:0:(genops.c:1229:class_import_put()) Process leaving 00000100:00001000:0.0:1789499365.653361:0:3613:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3c7fe5c60 time=77 v=5 (5 0 0 0) 02000000:00000010:3.0:1789499365.653363:0:3616:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665b00. 02000000:00000001:3.0:1789499365.653367:0:3616:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 00000100:00001000:0.0:1789499365.653369:0:3613:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3c7fe5c18 time=72 v=5 (1 0 0 0) 02000000:00000001:3.0:1789499365.653370:0:3616:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1789499365.653372:0:3616:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c27cbb80. 00000100:00000001:0.0:1789499365.653374:0:3613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.653380:0:3616:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653384:0:3616:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.653385:0:3613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653387:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1789499365.653389:0:3613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000100:00000001:3.0:1789499365.653392:0:3616:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00010000:00000001:0.0:1789499365.653393:0:3613:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653395:0:3616:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653397:0:3613:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000001:3.0:1789499365.653399:0:3616:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000040:0.0:1789499365.653401:0:3613:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 4294967355 00000100:00000001:3.0:1789499365.653402:0:3616:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653406:0:3613:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1789499365.653410:0:3613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.653415:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653428:0:29473:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1789499365.653431:0:29473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122725248 02000000:00000001:3.0:1789499365.653434:0:29473:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1789499365.653436:0:29473:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.653439:0:29473:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.653446:0:29473:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653447:0:3613:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00100000:3.0:1789499365.653451:0:29473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122725248 00000100:00000001:0.0:1789499365.653452:0:3613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1789499365.653455:0:3613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1789499365.653456:0:29473:0:(genops.c:792:class_conn2export()) Process entered 00000004:00000001:0.0:1789499365.653459:0:3613:0:(osp_precreate.c:128:osp_statfs_interpret()) Process entered 00000020:00000040:3.0:1789499365.653460:0:29473:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc0375e7 00000020:00000001:3.0:1789499365.653464:0:29473:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000004:00000040:0.0:1789499365.653466:0:3613:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=353107 avail=317404 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023730 state=0: rc = 0 00000020:00000040:3.0:1789499365.653467:0:29473:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab3c57ae000 refcount=5 00000020:00000001:3.0:1789499365.653472:0:29473:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632695635828736 : -111378073722880 : ffff9ab3c57ae000) 00000020:00000001:3.0:1789499365.653476:0:29473:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632695635828736 : -111378073722880 : ffff9ab3c57ae000) 00000004:00000020:0.0:1789499365.653478:0:3613:0:(osp_precreate.c:160:osp_statfs_interpret()) lustre-MDT0001-osp-MDT0000 (ffff9ab3c7fe4800): 353529 blocks, 353107 free, 317404 avail, 4096 bsize, 1 reserved mb low, 3 reserved mb high, 32 reserved ino low, 65 reserved ino high, 1024000 files, 1023730 free files 0x0 00000100:00000001:3.0:1789499365.653480:0:29473:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:3.0:1789499365.653484:0:29473:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000004:00000001:0.0:1789499365.653487:0:3613:0:(osp_precreate.c:162:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.653489:0:29473:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c6093f00. 00000100:00000040:0.0:1789499365.653494:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1789499365.653495:0:29473:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000100:00100000:0.0:1789499365.653507:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c46c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876424122723712:0@lo:41:osp-pre-1-0.0 00000100:00000001:3.0:1789499365.653509:0:29473:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000010:3.0:1789499365.653512:0:29473:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000100:00000001:0.0:1789499365.653513:0:3613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1789499365.653516:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000001:0.0:1789499365.653518:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000020:00000010:3.0:1789499365.653519:0:29473:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5380000. 00000020:00000040:2.0:1789499365.653521:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff9ab2c3083380) now 8 - evictor 00000100:00000040:0.0:1789499365.653524:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c46c7100 x1876424122723712/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1789499381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000010:3.0:1789499365.653525:0:29473:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fe700. 00000020:00000010:3.0:1789499365.653531:0:29473:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9708. 00000100:00000001:0.0:1789499365.653538:0:3613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 00000100:00000040:3.0:1789499365.653539:0:29473:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 02000000:00000001:0.0:1789499365.653541:0:3613:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 00000100:00000001:3.0:1789499365.653543:0:29473:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 02000000:00000010:0.0:1789499365.653545:0:3613:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff9ab3f865a800. 00000100:00000001:3.0:1789499365.653546:0:29473:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1789499365.653549:0:29473:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:0.0:1789499365.653551:0:3613:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000001:3.0:1789499365.653555:0:29473:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000020:00000001:0.0:1789499365.653555:0:3613:0:(genops.c:1216:class_import_put()) Process entered 00000100:00000001:3.0:1789499365.653560:0:29473:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000020:00000040:0.0:1789499365.653560:0:3613:0:(genops.c:1222:class_import_put()) import ffff9ab3c7fe5800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000001:3.0:1789499365.653563:0:29473:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1789499365.653565:0:3613:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:0.0:1789499365.653575:0:3613:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab3fcf67d00. 00000100:00000001:3.0:1789499365.653576:0:29473:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:0.0:1789499365.653579:0:3613:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1789499365.653582:0:3613:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789499365.653584:0:3613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c46c7100. 00000100:00000001:3.0:1789499365.653587:0:29473:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1789499365.653587:0:8391:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1789499365.653588:0:3613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1789499365.653590:0:29473:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:2.0:1789499365.653590:0:8391:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:0.0:1789499365.653592:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:2.0:1789499365.653597:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00000001:0.0:1789499365.653597:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1789499365.653603:0:8391:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab3c57ae000 : new rpc_count 1 00000100:00000001:3.0:1789499365.653604:0:29473:0:(service.c:2244:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653604:0:3613:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1789499365.653605:0:8391:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691282567040 : -111382426984576 : ffff9ab2c2015f80) 00000100:00000001:3.0:1789499365.653609:0:29473:0:(service.c:2488:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653609:0:3613:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000040:2.0:1789499365.653612:0:8391:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c2015f80 x1876424122725248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1789499376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.653616:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789499365.653620:0:3613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1789499365.653625:0:8416:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:2.0:1789499365.653625:0:8391:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000400:00000001:0.0:1789499365.653625:0:3613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000100:00100000:3.0:1789499365.653627:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424122724736 02000000:00000001:3.0:1789499365.653630:0:8416:0:(sec.c:2511:sptlrpc_svc_unwrap_request()) Process entered 00000400:00000001:0.0:1789499365.653630:0:3613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000020:00000010:2.0:1789499365.653631:0:8391:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c6093180. 00000100:00000001:3.0:1789499365.653634:0:8416:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1789499365.653635:0:8391:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000400:00000010:0.0:1789499365.653635:0:3613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3fcfbb5d8. 00000100:00000001:3.0:1789499365.653636:0:8416:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1789499365.653640:0:8416:0:(sec.c:2568:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1789499365.653641:0:8391:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c6093180. 00000400:00000200:0.0:1789499365.653642:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4aa0 00000100:00100000:3.0:1789499365.653643:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424122724736 00000020:00000001:3.0:1789499365.653663:0:8416:0:(genops.c:792:class_conn2export()) Process entered 00000100:00100000:2.0:1789499365.653663:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c2015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876424122725248:12345-0@lo:400:kworker.0 00000020:00000040:3.0:1789499365.653664:0:8416:0:(genops.c:804:class_conn2export()) looking for export cookie 0xc9302d10cc037706 00000020:00000001:3.0:1789499365.653666:0:8416:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000100:00000200:2.0:1789499365.653666:0:8391:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122725248 00000400:00000010:0.0:1789499365.653669:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4aa0. 00000020:00000040:3.0:1789499365.653670:0:8416:0:(lustre_handles.c:148:class_handle2object()) GET export ffff9ab2c4d2d800 refcount=5 00000020:00000001:2.0:1789499365.653670:0:8391:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:3.0:1789499365.653675:0:8416:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446632691329849344 : -111382379702272 : ffff9ab2c4d2d800) 00000020:00000001:2.0:1789499365.653675:0:8391:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000100:00000001:0.0:1789499365.653677:0:3613:0:(events.c:80:reply_in_callback()) Process entered 00000020:00000001:3.0:1789499365.653678:0:8416:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446632691329849344 : -111382379702272 : ffff9ab2c4d2d800) 00000020:00000001:2.0:1789499365.653678:0:8391:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653682:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000001:2.0:1789499365.653682:0:8391:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1789499365.653685:0:8391:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000020:00000010:3.0:1789499365.653687:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00000200:0.0:1789499365.653687:0:3613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:2.0:1789499365.653689:0:8391:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000010:3.0:1789499365.653691:0:8416:0:(genops.c:1111:obd_export_timed_del()) kfreed 'ned': 48 at ffff9ab2c36f5b00. 00000020:00000001:2.0:1789499365.653692:0:8391:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1789499365.653696:0:8391:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000040:3.0:1789499365.653697:0:8416:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00000020:00000001:2.0:1789499365.653702:0:8391:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000200:0.0:1789499365.653704:0:3613:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:2.0:1789499365.653706:0:8391:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653707:0:8416:0:(service.c:1358:ptlrpc_update_export_timer()) Process leaving 00000020:00000010:3.0:1789499365.653709:0:8416:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000020:00000001:2.0:1789499365.653710:0:8391:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:2.0:1789499365.653714:0:8391:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 00000020:00000010:3.0:1789499365.653715:0:8416:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9ab2c5380a00. 02000000:00000001:2.0:1789499365.653717:0:8391:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000001:0.0:1789499365.653719:0:3613:0:(events.c:165:reply_in_callback()) Process leaving 00000020:00000010:3.0:1789499365.653720:0:8416:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9ab3d05fe680. 02000000:00000010:2.0:1789499365.653720:0:8391:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab2c3d80c00. 00000100:00000001:0.0:1789499365.653723:0:3613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000020:00000010:3.0:1789499365.653724:0:8416:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9ab3c7ed9000. 02000000:00000001:2.0:1789499365.653724:0:8391:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.653730:0:8416:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +45s 00000100:00000001:2.0:1789499365.653730:0:8391:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653730:0:3613:0:(client.c:1593:after_reply()) Process entered 00000100:00000001:3.0:1789499365.653734:0:8416:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000020:00000001:2.0:1789499365.653734:0:8391:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789499365.653735:0:3613:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1789499365.653736:0:8416:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00010000:00000040:2.0:1789499365.653737:0:8391:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 4294968892, transno 0, xid 1876424122725248 00000100:00000001:0.0:1789499365.653738:0:3613:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1789499365.653739:0:8416:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:2.0:1789499365.653739:0:8391:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:0.0:1789499365.653742:0:3613:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653744:0:8416:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00010000:00000200:2.0:1789499365.653746:0:8391:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c2015f80 x1876424122725248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653747:0:8416:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 02000000:00000001:0.0:1789499365.653747:0:3613:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653749:0:8416:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1789499365.653755:0:8391:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000100:00001000:0.0:1789499365.653756:0:3613:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab3f5f7dc60 time=24 v=36 (36 36 5 5) 00000100:00000001:3.0:1789499365.653757:0:8416:0:(service.c:2450:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:2.0:1789499365.653757:0:8391:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1789499365.653762:0:8391:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3ee9489e8 time=12 v=5 (1 1 1 1) 00000100:00001000:0.0:1789499365.653764:0:3613:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f5f7dc18 time=72 v=5 (1 0 0 0) 00000100:00000001:2.0:1789499365.653766:0:8391:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000001:0.0:1789499365.653770:0:3613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1789499365.653771:0:8416:0:(service.c:2484:ptlrpc_server_handle_request()) Process entered 00000100:00000040:2.0:1789499365.653771:0:8391:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00000001:0.0:1789499365.653774:0:3613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653775:0:8416:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00000001:2.0:1789499365.653775:0:8391:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000100:00100000:3.0:1789499365.653780:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 02000000:00000001:2.0:1789499365.653781:0:8391:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 00010000:00000001:0.0:1789499365.653781:0:3613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000100:00000040:3.0:1789499365.653783:0:8416:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9ab2c4d2d800 : new rpc_count 1 02000000:00000001:2.0:1789499365.653783:0:8391:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.653785:0:3613:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1789499365.653786:0:8416:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446632691282561664 : -111382426989952 : ffff9ab2c2014a80) 00000100:00000001:2.0:1789499365.653786:0:8391:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789499365.653790:0:8391:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:0.0:1789499365.653791:0:3613:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1789499365.653793:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9ab2c2014a80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:680/0 lens 224/0 e 0 to 0 dl 1789499415 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1789499365.653793:0:8391:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3c63e22a8. 00000100:00000040:0.0:1789499365.653795:0:3613:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000200:2.0:1789499365.653797:0:8391:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1876424122725248, offset 224 00000100:00000001:0.0:1789499365.653800:0:3613:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1789499365.653803:0:8416:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000400:00000200:2.0:1789499365.653803:0:8391:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000010:3.0:1789499365.653805:0:8416:0:(genops.c:1054:obd_export_timed_init()) kmalloced '(*data)': 48 at ffff9ab2c4816380. 00000100:00000001:3.0:1789499365.653807:0:8416:0:(service.c:1300:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:3.0:1789499365.653811:0:8416:0:(genops.c:1062:obd_export_timed_fini()) kfreed '*data': 48 at ffff9ab2c4816380. 00000400:00000200:2.0:1789499365.653811:0:8391:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:0.0:1789499365.653811:0:3613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499365.653817:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab2c2014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876424122724736:12345-0@lo:400:kworker.0 00000400:00000200:2.0:1789499365.653821:0:8391:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6aa9909487380 00000100:00000200:3.0:1789499365.653822:0:8416:0:(service.c:2568:ptlrpc_server_handle_request()) got req 1876424122724736 00000100:00000040:0.0:1789499365.653822:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.653826:0:8416:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000400:00000200:2.0:1789499365.653827:0:8391:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0x35f81 [1] + 224 00000020:00000001:3.0:1789499365.653828:0:8416:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:3.0:1789499365.653831:0:8416:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1789499365.653835:0:8416:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000400:00000200:2.0:1789499365.653836:0:8391:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000020:00000001:3.0:1789499365.653837:0:8416:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072653546528 : -1056005088 : ffffffffc10ea420) 00000020:00000001:3.0:1789499365.653839:0:8416:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000400:00000200:2.0:1789499365.653839:0:8391:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000020:00000001:3.0:1789499365.653841:0:8416:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1789499365.653842:0:8391:0:(events.c:80:reply_in_callback()) Process entered 00000020:00000001:3.0:1789499365.653843:0:8416:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1789499365.653844:0:8416:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000100:00000200:2.0:1789499365.653846:0:8391:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.653847:0:8416:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.653857:0:3613:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000040:2.0:1789499365.653861:0:8391:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.653863:0:8416:0:(tgt_handler.c:1163:tgt_obd_ping()) Process entered 00000100:00000001:0.0:1789499365.653863:0:3613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1789499365.653867:0:3613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1789499365.653868:0:8416:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1789499365.653870:0:8416:0:(sec.c:2590:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1789499365.653875:0:8416:0:(sec_null.c:300:null_alloc_rs()) kmalloced '(rs)': 520 at ffff9ab3d04f1c00. 00000100:00000001:2.0:1789499365.653877:0:8391:0:(events.c:165:reply_in_callback()) Process leaving 02000000:00000001:3.0:1789499365.653878:0:8416:0:(sec.c:2627:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.653878:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.653882:0:8416:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1789499365.653882:0:8391:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3c63e22a8 00000400:00000010:2.0:1789499365.653885:0:8391:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3c63e22a8. 00000020:00000001:3.0:1789499365.653895:0:8416:0:(tgt_handler.c:1184:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1789499365.653898:0:8391:0:(events.c:390:reply_out_callback()) Process entered 00010000:00000040:3.0:1789499365.653899:0:8416:0:(ldlm_lib.c:3342:target_committed_to_req()) last_committed 0, transno 0, xid 1876424122724736 00000100:00000001:2.0:1789499365.653899:0:8391:0:(events.c:402:reply_out_callback()) Process leaving 00010000:00000001:3.0:1789499365.653904:0:8416:0:(ldlm_lib.c:3411:target_send_reply()) Process entered 00000100:00000001:2.0:1789499365.653904:0:8391:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00010000:00000200:3.0:1789499365.653909:0:8416:0:(ldlm_lib.c:3399:target_send_reply_msg()) @@@ sending reply req@ffff9ab2c2014a80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1789499365.653912:0:8391:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00000100:00100000:0.0:1789499365.653912:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c27c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876424122724224:0@lo:400:kworker.0 00010000:00000001:2.0:1789499365.653917:0:8391:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:2.0:1789499365.653919:0:8391:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1789499365.653923:0:8391:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00010000:00000001:3.0:1789499365.653926:0:8416:0:(ldlm_lib.c:3354:target_pack_pool_reply()) Process entered 00000400:00000001:0.0:1789499365.653927:0:3613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00010000:00000001:3.0:1789499365.653928:0:8416:0:(ldlm_lib.c:3375:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1789499365.653928:0:8391:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c2015f80 x1876424122725248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:641/0 lens 224/224 e 0 to 0 dl 1789499376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000001:0.0:1789499365.653931:0:3613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000100:00001000:3.0:1789499365.653932:0:8416:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3f42771e8 time=29 v=36 (1 36 4 1) 00000400:00000010:0.0:1789499365.653935:0:3613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3f5ea4160. 00000100:00000001:3.0:1789499365.653937:0:8416:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1789499365.653940:0:8416:0:(connection.c:162:ptlrpc_connection_addref()) conn=ffff9ab3c63e4b00 refcount 66 to 0@lo 00000100:00100000:2.0:1789499365.653941:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c2015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876424122725248:12345-0@lo:400:kworker.0 Request processed in 313us (1012us total) trans 0 rc 0/0 00000400:00000200:0.0:1789499365.653942:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab400970550 00000100:00000001:3.0:1789499365.653944:0:8416:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446632695648635648 : -111378060915968 : ffff9ab3c63e4b00) 00000400:00000010:0.0:1789499365.653947:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab400970550. 02000000:00000001:3.0:1789499365.653948:0:8416:0:(sec.c:2641:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1789499365.653950:0:8416:0:(sec.c:2652:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1789499365.653951:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00000001:3.0:1789499365.653954:0:8416:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1789499365.653955:0:8391:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab3c57ae000 : new rpc_count 0 00000100:00000001:0.0:1789499365.653955:0:3613:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000040:3.0:1789499365.653956:0:8416:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:2.0:1789499365.653960:0:8391:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000400:00000010:3.0:1789499365.653961:0:8416:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9ab3fbccf880. 00000100:00000001:2.0:1789499365.653962:0:8391:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000100:00000200:3.0:1789499365.653963:0:8416:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1876424122724736, offset 224 00000020:00000010:2.0:1789499365.653965:0:8391:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fe700. 00000100:00000200:0.0:1789499365.653966:0:3613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1789499365.653969:0:8416:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000020:00000010:2.0:1789499365.653969:0:8391:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9708. 00000020:00000010:2.0:1789499365.653973:0:8391:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5380000. 00000400:00000200:3.0:1789499365.653978:0:8416:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000020:00000040:2.0:1789499365.653979:0:8391:0:(genops.c:879:class_export_put()) PUTting export ffff9ab3c57ae000 : new refcount 4 00000100:00000001:2.0:1789499365.653982:0:8391:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1789499365.653988:0:8416:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6aa9909487180 00000400:00000200:3.0:1789499365.653995:0:8416:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0x35f31 [1] + 224 00000400:00000200:3.0:1789499365.654000:0:8416:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1789499365.654003:0:8416:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1789499365.654006:0:8416:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1789499365.654010:0:8416:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1789499365.654019:0:8416:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1789499365.654026:0:8416:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1789499365.654030:0:8416:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab3fbccf880 00000400:00000010:3.0:1789499365.654031:0:8416:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab3fbccf880. 00000100:00000001:3.0:1789499365.654034:0:8416:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1789499365.654035:0:8416:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1789499365.654038:0:8416:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.654040:0:8416:0:(lustre_net.h:1978:ptlrpc_connection_put()) PUT conn=ffff9ab3c63e4b00 refcount 65 to 0@lo 00010000:00000001:3.0:1789499365.654042:0:8416:0:(ldlm_lib.c:3423:target_send_reply()) Process leaving 00000020:00000001:3.0:1789499365.654044:0:8416:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:0.0:1789499365.654048:0:3613:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:3.0:1789499365.654050:0:8416:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1789499365.654056:0:8416:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c2014a80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1789499415 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654062:0:3613:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1789499365.654066:0:3613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654070:0:3613:0:(client.c:1593:after_reply()) Process entered 00000100:00100000:3.0:1789499365.654072:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab2c2014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876424122724736:12345-0@lo:400:kworker.0 Request processed in 266us (1660us total) trans 0 rc 0/0 02000000:00000001:0.0:1789499365.654073:0:3613:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1789499365.654076:0:3613:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.654080:0:3613:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1789499365.654084:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 02000000:00000001:0.0:1789499365.654085:0:3613:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1789499365.654089:0:8416:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ab2c4d2d800 : new rpc_count 0 00000100:00000001:3.0:1789499365.654092:0:8416:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00001000:0.0:1789499365.654092:0:3613:0:(import.c:2196:obd_at_measure()) add 5 to ffff9ab3e08b3460 time=77 v=5 (5 0 0 0) 00000100:00000001:3.0:1789499365.654095:0:8416:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1789499365.654099:0:8416:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9ab3d05fe680. 00000100:00001000:0.0:1789499365.654099:0:3613:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab3e08b3418 time=77 v=5 (1 0 0 0) 00000020:00000010:3.0:1789499365.654104:0:8416:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9ab3c7ed9000. 00000100:00000001:0.0:1789499365.654105:0:3613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1789499365.654108:0:3613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.654110:0:3613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1789499365.654112:0:3613:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1789499365.654114:0:8416:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9ab2c5380a00. 00000100:00000001:0.0:1789499365.654115:0:3613:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000020:00000040:3.0:1789499365.654118:0:8416:0:(genops.c:879:class_export_put()) PUTting export ffff9ab2c4d2d800 : new refcount 4 00000100:00000001:3.0:1789499365.654121:0:8416:0:(service.c:2640:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789499365.654125:0:3613:0:(client.c:3122:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968892 00000100:00000001:0.0:1789499365.654128:0:3613:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1789499365.654129:0:3613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:3.0:1789499365.654132:0:6478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:0.0:1789499365.654136:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1789499365.654137:0:6478:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff9ab2c30819c0) now 16 - evictor 00000100:00000001:0.0:1789499365.654201:0:3613:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.654205:0:3613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1789499365.654206:0:3613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789499365.654209:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.654214:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876424122725248:0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.654217:0:3613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.654218:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1789499365.654220:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c27c8700 x1876424122724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654223:0:3613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1789499365.654224:0:3613:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1789499365.654226:0:3613:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab3f5281000. 02000000:00000001:0.0:1789499365.654228:0:3613:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1789499365.654229:0:3613:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:0.0:1789499365.654230:0:3613:0:(genops.c:1222:class_import_put()) import ffff9ab3f5f7d800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:00000001:0.0:1789499365.654231:0:3613:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:0.0:1789499365.654232:0:3613:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665900. 02000000:00000001:0.0:1789499365.654234:0:3613:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1789499365.654235:0:3613:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789499365.654235:0:3613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c27c8700. 00000100:00000001:0.0:1789499365.654237:0:3613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1789499365.654238:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654239:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1789499365.654240:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb5880 x1876424122725248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789499381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654243:0:3613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1789499365.654244:0:3613:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1789499365.654250:0:3613:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab3ec419c00. 02000000:00000001:0.0:1789499365.654251:0:3613:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1789499365.654252:0:3613:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:0.0:1789499365.654253:0:3613:0:(genops.c:1222:class_import_put()) import ffff9ab3e08b3000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000001:0.0:1789499365.654254:0:3613:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:0.0:1789499365.654255:0:3613:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665f00. 02000000:00000001:0.0:1789499365.654256:0:3613:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1789499365.654257:0:3613:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789499365.654257:0:3613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb5880. 00000100:00000001:0.0:1789499365.654259:0:3613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1789499365.654259:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654261:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.654262:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789499365.654263:0:3613:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1789499365.654264:0:3613:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1789499365.654265:0:3613:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1789499365.654266:0:3613:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at ffff9ab3fcfbb6e0. 00000400:00000200:0.0:1789499365.654268:0:3613:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9ab4009a4c38 00000400:00000010:0.0:1789499365.654269:0:3613:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at ffff9ab4009a4c38. 00000100:00000001:0.0:1789499365.654270:0:3613:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1789499365.654272:0:3613:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1789499365.654277:0:3613:0:(events.c:104:reply_in_callback()) @@@ unlink req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654281:0:3613:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1789499365.654281:0:3613:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654282:0:3613:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1789499365.654283:0:3613:0:(sec.c:1131:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1789499365.654284:0:3613:0:(pack_generic.c:607:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1789499365.654285:0:3613:0:(pack_generic.c:625:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1789499365.654286:0:3613:0:(sec.c:1193:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1789499365.654289:0:3613:0:(import.c:2196:obd_at_measure()) add 36 to ffff9ab2c32de460 time=151 v=36 (36 5 5 101) 00000100:00001000:0.0:1789499365.654291:0:3613:0:(import.c:2196:obd_at_measure()) add 1 to ffff9ab2c32de418 time=72 v=5 (1 0 0 0) 00000100:00000001:0.0:1789499365.654293:0:3613:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1789499365.654294:0:3613:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1789499365.654295:0:3613:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1789499365.654297:0:3613:0:(ldlm_request.c:1683:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.654301:0:3613:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1789499365.654302:0:3613:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000001:0.0:1789499365.654303:0:3613:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1789499365.654304:0:3613:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1789499365.654306:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654310:0:3613:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1789499365.654311:0:3613:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1789499365.654311:0:3613:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1789499365.654313:0:3613:0:(lustre_net.h:2418:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789499365.654317:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ab2c3fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876424122724736:0@lo:400:kworker.0 00000100:00000001:0.0:1789499365.654319:0:3613:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654321:0:3613:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1789499365.654323:0:3613:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9ab2c3fb7b80 x1876424122724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789499420 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1789499365.654329:0:3613:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1789499365.654330:0:3613:0:(sec.c:1895:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1789499365.654332:0:3613:0:(sec_null.c:192:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9ab3f5280000. 02000000:00000001:0.0:1789499365.654334:0:3613:0:(sec.c:1911:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1789499365.654335:0:3613:0:(genops.c:1216:class_import_put()) Process entered 00000020:00000040:0.0:1789499365.654337:0:3613:0:(genops.c:1222:class_import_put()) import ffff9ab2c32de000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000020:00000001:0.0:1789499365.654338:0:3613:0:(genops.c:1229:class_import_put()) Process leaving 02000000:00000010:0.0:1789499365.654339:0:3613:0:(sec_null.c:162:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9ab2c2665e00. 02000000:00000001:0.0:1789499365.654341:0:3613:0:(sec.c:479:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1789499365.654342:0:3613:0:(sec.c:496:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1789499365.654344:0:3613:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9ab2c3fb7b80. 00000100:00000001:0.0:1789499365.654346:0:3613:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1789499365.654347:0:3613:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654348:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1789499365.654352:0:3613:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1789499365.654353:0:3613:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1789499365.654355:0:3613:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1789499365.654357:0:3613:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.769057:0:36052:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.769064:0:36052:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.769069:0:36052:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.769075:0:36052:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.769079:0:36052:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.769082:0:36052:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.769087:0:36052:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.769091:0:36052:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.769094:0:36052:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) 00080000:00000010:0.0:1789499365.769103:0:36052:0:(osd_handler.c:2598:osd_statfs()) kmalloced '(ksfs)': 120 at ffff9ab3d0329000. 00080000:00000010:0.0:1789499365.769106:0:36052:0:(osd_handler.c:2639:osd_statfs()) kfreed 'ksfs': 120 at ffff9ab3d0329000. 00000020:00000001:0.0:1789499365.769110:0:36052:0:(tgt_mount.c:2304:server_show_options()) Process leaving (rc=0 : 0 : 0) Debug log: 4034 lines, 4034 kept, 0 dropped, 0 bad.